00000001:02000400:2.0F:1788305032.810315:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788305051.192594:0:3178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788305052.860409:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 350 MB/s 00000001:01000000:2.0:1788305053.110394:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 575 MB/s 00000001:01000000:3.0F:1788305053.360099:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3103 MB/s 00000020:02000000:2.0:1788305054.115325:0:3270:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_44_g3acc781 00000400:02000000:3.0:1788305055.094434:0:3285:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.138@tcp [8/256/0/180] 00008000:02000000:1.0:1788305059.015676:0:3435:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788305121.609593:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788305132.314165:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305132.314170:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788305132.314245:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000032d4ca7b 00000080:02000400:3.0:1788305132.314254:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788305132.322799:0:5814:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788305132.322813:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788305132.322857:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000aaf6052) 00000020:00000080:2.0:1788305132.322972:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788305132.344921:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788305132.345211:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0F:1788305132.368516:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788305132.368568:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788305132.368587:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788305132.368633:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788305132.368659:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788305132.369091:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788305132.369099:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305132.369110:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae8169 00000020:01000004:0.0:1788305132.369118:0:5814:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788305132.369123:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788305132.369127:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000032d4ca7b from MGS 00000020:01000004:0.0:1788305132.369131:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788305132.369148:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000038e0390c) 00000020:00000080:0.0:1788305132.369167:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788305132.369270:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000032d4ca7b from MGS, refs=2 00080000:01000000:0.0:1788305132.369275:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788305132.369281:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae8177 00000100:00100000:0.0:1788305132.369375:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788305132.369520:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788305132.369526:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788305132.370226:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788305132.370296:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788305132.371034:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305132.371250:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788305132.371255:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788305132.371793:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788305132.371800:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788305132.372286:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788305132.372292:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788305132.372859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305132.372863:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305132.372865:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305132.375454:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305132.375461:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305132.375463:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305132.376228:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788305132.381116:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788305132.626292:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4535 MB/s 00000001:01000000:0.0:1788305132.876652:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3459 MB/s 00000001:01000000:2.0:1788305133.128010:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 350 MB/s 00000001:01000000:3.0:1788305133.377224:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 587 MB/s 00080000:10000000:3.0:1788305133.399374:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788305133.428959:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788305133.428975:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788305133.428978:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788305133.429353:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788305133.429377:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788305133.429412:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:1.0:1788305133.433961:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305133.435739:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788305133.435788:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788305133.437272:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305133.437819:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788305133.437826:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788305133.439514:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788305133.439526:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788305133.440794:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788305133.440806:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788305133.441927:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788305133.441945:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788305133.441966:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.138@tcp' 00000020:01000004:2.0:1788305133.441969:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788305133.442019:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.138@tcp (typ=mgc) 00000020:00000080:2.0:1788305133.442038:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.138@tcp (0000000017b7a3a7) 00000020:00000080:2.0:1788305133.442083:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788305133.442182:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002810ebe3@MGC192.168.201.138@tcp: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788305133.442321:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.138@tcp-0 is initialized 00000040:01000000:2.0:1788305133.442328:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788305133.447867:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788305133.448670:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.138@tcp (uuid 16674bd8-0f21-440d-92a6-ff3988850e9b) 00000020:00000080:2.0:1788305133.448696:0:5814:0:(genops.c:1385:class_connect()) connect: client 16674bd8-0f21-440d-92a6-ff3988850e9b, cookie 0x902a3611c9ae8185 00000100:00080000:2.0:1788305133.448708:0:5814:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305133.448713:0:5814:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import 000000002810ebe3 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788305133.448757:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ee739910 x1875173761351808/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305133.448780:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS 00000020:01000004:2.0:1788305133.448796:0:5814:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788305133.448801:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788305133.448814:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d652d52b) 00000020:00000080:2.0:1788305133.448828:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788305133.452644:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee739910 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16674bd8-0f21-440d-92a6-ff3988850e9b:3300:1875173761351808:0@lo:250: 00000100:00100000:1.0:1788305133.452730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305133.456107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761351808 00000100:00100000:3.0:1788305133.456123:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761351808 00000100:00100000:3.0:1788305133.456171:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305133.456178:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036189396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1875173761351808:12345-0@lo:250: 00010000:00080000:3.0:1788305133.456206:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 16674bd8-0f21-440d-92a6-ff3988850e9b@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1788305133.456235:0:5826:0:(genops.c:1385:class_connect()) connect: client 16674bd8-0f21-440d-92a6-ff3988850e9b, cookie 0x902a3611c9ae8193 00000100:00080000:3.0:1788305133.459772:0:5826:0:(import.c:65:import_set_state_nolock()) 0000000089bcc4d9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305133.459879:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036189396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+5:3300:x1875173761351808:12345-0@lo:250: Request processed in 3699us (7149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305133.459890:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305133.459904:0:3300:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788305133.459914:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.138@tcp: connect to target with instance 0 00000100:00080000:1.0:1788305133.459921:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788305133.459926:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788305133.459929:0:3300:0:(import.c:65:import_set_state_nolock()) 000000002810ebe3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788305133.459931:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788305133.459939:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788305133.459943:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee739910 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16674bd8-0f21-440d-92a6-ff3988850e9b:3300:1875173761351808:0@lo:250: 00000100:00100000:2.0:1788305133.466021:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305133.466241:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305133.466247:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788305133.471885:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305133.471903:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788305133.472456:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788305133.472465:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788305133.473331:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305133.473819:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788305133.473825:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788305133.477196:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788305133.477209:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788305133.555867:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305133.556257:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788305133.556264:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788305133.566678:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788305133.566694:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788305133.578927:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305133.579162:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305133.579177:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788305133.579897:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788305133.579909:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788305133.583242:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305133.584536:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305133.584545:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788305133.595638:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788305133.595660:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788305133.597648:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305133.597845:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788305133.597851:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788305133.614348:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788305133.614362:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788305133.642834:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305133.643034:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305133.643041:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788305133.646199:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305133.646214:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788305133.646873:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305133.646883:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788305133.649022:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788305133.649049:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788305133.649081:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788305133.649225:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788305133.649265:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788305133.649269:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788305133.649271:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305133.649272:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305133.649274:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305133.649275:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305133.649276:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305133.649278:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305133.649279:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305133.649280:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305133.649281:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305133.649282:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305133.649283:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305133.649286:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788305133.649288:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305133.649289:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305133.649290:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305133.649291:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305133.649292:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305133.649293:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305133.649294:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305133.649295:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305133.649296:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305133.649296:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305133.649297:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305133.649298:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305133.649324:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788305133.649339:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062024e92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761351936:0@lo:253: 00000100:00100000:2.0:1788305133.649553:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305133.649609:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073015bfd going to sleep for 11 seconds 00000100:00100000:1.0:1788305133.649912:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761351936 00000100:00100000:1.0:1788305133.649920:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761351936 00000100:00100000:1.0:1788305133.649978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305133.649986:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fdab642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+5:5814:x1875173761351936:12345-0@lo:253: 20000000:01000000:1.0:1788305133.650020:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788305133.650023:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788305133.650540:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788305133.650586:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788305133.650803:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305133.652006:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788305133.652242:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788305133.652246:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788305133.652250:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788305133.652253:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788305133.652264:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788305133.652414:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305133.652633:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788305133.652644:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788305133.652676:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788305133.652701:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788305133.652721:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788305133.652798:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788305133.652806:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788305133.652849:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788305133.652857:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788305133.652886:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788305133.652892:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788305133.652909:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788305133.652935:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788305133.652954:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788305133.652957:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788305133.652964:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305133.653153:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788305133.653161:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788305133.653180:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788305133.653197:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788305133.653256:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788305133.653269:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788305133.653314:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788305133.653319:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788305133.653343:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788305133.653362:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788305133.653387:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788305133.653394:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788305133.653440:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788305133.653460:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788305133.653481:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788305133.653510:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788305133.653650:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788305133.653681:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788305133.653686:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788305133.660813:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788305133.661243:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788305133.661271:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.138@tcp for mdt 20000000:01000000:3.0:1788305133.661274:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:3.0:1788305133.661322:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788305133.661331:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788305133.661363:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788305133.661370:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:3.0:1788305133.661414:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788305133.661424:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788305133.661477:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788305133.661520:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788305133.661590:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788305133.661594:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788305133.661598:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788305133.661609:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788305133.661611:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788305133.661640:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788305133.661642:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788305133.663553:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788305133.664791:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788305133.664848:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788305133.664884:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788305133.664896:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788305133.664899:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788305133.666498:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788305133.666698:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788305133.666726:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788305133.666780:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788305133.666797:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788305133.666799:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788305133.666804:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788305133.666806:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788305133.666811:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788305133.666817:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788305133.668818:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788305133.669404:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788305133.687013:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788305133.687094:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788305133.687205:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788305133.687228:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788305133.687247:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687741:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687755:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687770:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687777:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687784:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687790:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000378baddc already unused, calling callback (00000000d7cc4453) 00010000:00010000:2.0:1788305133.687793:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687800:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687812:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687819:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.687825:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000378baddc/0x902a3611c9ae819a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788305133.687844:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788305133.995546:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fdab642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+5:5814:x1875173761351936:12345-0@lo:253: Request processed in 345554us (345986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305133.995565:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305133.995795:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062024e92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761351936:0@lo:253: 10000000:01000000:1.0:1788305133.995810:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788305133.995813:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305133.995816:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305133.995817:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305133.995831:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788305133.995832:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305133.995833:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305133.995834:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305133.995836:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305133.995837:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788305133.995838:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305133.995840:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788305133.995857:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000032d4ca7b from lustre-MDT0000 10000000:01000000:1.0:1788305133.995882:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788305133.995885:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788305133.995888:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96fba05219b8 10000000:01000000:1.0:1788305133.995893:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305133.995900:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96fba05219b8 from 1 10000000:01000000:1.0:1788305133.995903:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788305133.995951:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.995962:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.995971:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305133.995989:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352064:0@lo:101: 00000100:00100000:1.0:1788305133.996025:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305133.996090:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c3eaa9e going to sleep for 11 seconds 00000100:00100000:2.0:1788305133.996188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352064 00000100:00100000:2.0:1788305133.996201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352064 00000100:00100000:2.0:1788305133.996248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305133.996257:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033927833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+5:5814:x1875173761352064:12345-0@lo:101: 00010000:00010000:2.0:1788305133.996269:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305133.996281:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000378baddc/0x902a3611c9ae81a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae81a1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.996428:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000378baddc/0x902a3611c9ae81a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.996449:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000378baddc/0x902a3611c9ae81a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.996459:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000378baddc, rc 0) 00000100:00100000:2.0:1788305133.996546:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033927833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+6:5814:x1875173761352064:12345-0@lo:101: Request processed in 290us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305133.996553:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305133.996729:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352064:0@lo:101: 00010000:00010000:1.0:1788305133.996742:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.996750:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305133.996812:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352192:0@lo:501: 00000100:00100000:1.0:1788305133.996838:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305133.996908:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c3eaa9e going to sleep for 11 seconds 00000100:00100000:2.0:1788305133.997008:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352192 00000100:00100000:2.0:1788305133.997014:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352192 00000100:00100000:0.0:1788305133.997226:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305133.997235:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003fe8cd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+6:5814:x1875173761352192:12345-0@lo:501: 00000100:00100000:0.0:1788305133.997753:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003fe8cd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+6:5814:x1875173761352192:12345-0@lo:501: Request processed in 519us (913us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305133.997761:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305133.997855:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352192:0@lo:501: 10000000:01000000:1.0:1788305133.997882:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788305133.997938:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.997947:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000c3598900/0x902a3611c9ae81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305133.997955:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96fb8951b000 10000000:01000000:1.0:1788305133.997960:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788305133.997964:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96fb8951b000 10000000:01000000:1.0:1788305133.997966:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788305133.997969:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96fb8951b000 from 1 10000000:01000000:1.0:1788305133.997972:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788305133.997994:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.998002:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.998010:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305133.998025:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352320:0@lo:101: 00000100:00100000:1.0:1788305133.998084:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305133.998116:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c3eaa9e going to sleep for 11 seconds 00000100:00100000:2.0:1788305133.998172:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352320 00000100:00100000:2.0:1788305133.998177:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352320 00000100:00100000:2.0:1788305133.998211:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305133.998217:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa37d7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+6:5814:x1875173761352320:12345-0@lo:101: 00010000:00010000:2.0:1788305133.998226:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305133.998237:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050cb2b4b/0x902a3611c9ae81b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae81af expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.998255:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050cb2b4b/0x902a3611c9ae81b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae81af expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.998276:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050cb2b4b/0x902a3611c9ae81b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae81af expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305133.998284:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050cb2b4b, rc 0) 00000100:00100000:2.0:1788305133.998334:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa37d7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+7:5814:x1875173761352320:12345-0@lo:101: Request processed in 117us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305133.998340:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305133.998529:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352320:0@lo:101: 00010000:00010000:1.0:1788305133.998540:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.998547:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305133.998560:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788305133.998772:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.998780:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000e2c6d233/0x902a3611c9ae81af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305133.998786:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788305133.998790:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305133.998795:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96fb8951b000 10000000:01000000:1.0:1788305133.998797:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788305133.998800:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788305133.998802:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788305133.998815:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.998822:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.998829:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305133.998848:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352448:0@lo:101: 00000100:00100000:1.0:1788305133.998875:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305133.998898:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c3eaa9e going to sleep for 11 seconds 00000100:00100000:3.0:1788305133.998946:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352448 00000100:00100000:3.0:1788305133.998951:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352448 00000100:00100000:3.0:1788305133.998982:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305133.998989:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011a0c75c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+7:5814:x1875173761352448:12345-0@lo:101: 00010000:00010000:3.0:1788305133.998997:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305133.999006:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b58db043/0x902a3611c9ae81c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae81bd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305133.999020:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b58db043/0x902a3611c9ae81c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305133.999028:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b58db043/0x902a3611c9ae81c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305133.999034:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b58db043, rc 0) 00000100:00100000:3.0:1788305133.999088:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011a0c75c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+8:5814:x1875173761352448:12345-0@lo:101: Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305133.999094:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305133.999165:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352448:0@lo:101: 00010000:00010000:1.0:1788305133.999175:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305133.999181:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305133.999225:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352576:0@lo:501: 00000100:00100000:1.0:1788305133.999248:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305133.999276:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c3eaa9e going to sleep for 11 seconds 00000100:00100000:3.0:1788305133.999390:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352576 00000100:00100000:3.0:1788305133.999394:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352576 00000100:00100000:3.0:1788305133.999446:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305133.999453:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3d92260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+8:5814:x1875173761352576:12345-0@lo:501: 00000100:00100000:3.0:1788305133.999802:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3d92260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5814:x1875173761352576:12345-0@lo:501: Request processed in 350us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305133.999810:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305133.999912:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352576:0@lo:501: 00000100:00100000:1.0:1788305133.999942:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352704:0@lo:503: 00000100:00100000:1.0:1788305133.999982:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305134.000005:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c3eaa9e going to sleep for 11 seconds 00000100:00100000:3.0:1788305134.000082:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352704 00000100:00100000:3.0:1788305134.000086:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352704 00000100:00100000:3.0:1788305134.000110:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305134.000122:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070577c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5814:x1875173761352704:12345-0@lo:503: 00000100:00100000:3.0:1788305134.000265:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070577c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5814:x1875173761352704:12345-0@lo:503: Request processed in 144us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305134.000273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788305134.000728:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761352704:0@lo:503: 00000100:00100000:0.0:1788305134.001939:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5856:1875173761352832:0@lo:502: 00000100:00100000:0.0:1788305134.002003:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305134.002091:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d535f6d going to sleep for 11 seconds 00000100:00100000:3.0:1788305134.002149:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352832 00000100:00100000:3.0:1788305134.002155:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352832 00000100:00100000:3.0:1788305134.002229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305134.002237:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff40a3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5856:x1875173761352832:12345-0@lo:502: 00000100:00100000:3.0:1788305134.002587:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff40a3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5856:x1875173761352832:12345-0@lo:502: Request processed in 351us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305134.002594:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305134.002687:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5856:1875173761352832:0@lo:502: 00000020:01000000:0.0:1788305134.002713:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305134.002724:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305134.002727:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788305134.002733:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788305134.002736:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305134.002748:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004394c280) 00000020:00000080:0.0:1788305134.002766:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788305134.002772:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788305134.002844:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788305134.002850:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae81d2 00000020:00000080:0.0:1788305134.003103:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788305134.003108:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305134.003111:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305134.003112:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788305134.003115:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305134.003119:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305134.003125:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788305134.003129:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305134.003135:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c050ea15) 00000020:00000080:0.0:1788305134.003145:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788305134.003148:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788305134.003150:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788305134.003153:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788305134.003158:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788305134.003199:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000032d4ca7b from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788305134.003210:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ac1c41d2) 00000020:00000080:0.0:1788305134.003217:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788305134.003255:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788305134.003259:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae81e7 00000020:00000080:0.0:1788305134.003366:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788305134.003372:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788305134.003376:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x902a3611c9ae81ee 00080000:01000000:0.0:1788305134.003380:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788305134.003383:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae81f5 00080000:10000000:0.0:1788305134.003792:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788305134.003987:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788305134.008110:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788305134.104791:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788305134.105353:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788305134.112231:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788305134.112849:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788305134.158984:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000821323e1) 00000020:00000080:3.0:1788305134.159005:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788305134.159162:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788305134.159169:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae8203 00000020:00000080:1.0:1788305134.161635:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788305134.166226:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.216212:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.244876:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305134.297271:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.387525:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.444012:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788305134.451744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305134.485022:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x902a3611c9ae820a 00000020:00000080:3.0:1788305134.485691:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788305134.485703:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305134.485710:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305134.485712:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788305134.485716:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305134.485720:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305134.485721:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305134.485724:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305134.485725:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305134.485728:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305134.485730:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305134.485736:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788305134.485739:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305134.485744:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305134.485745:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788305134.485748:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788305134.485789:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788305134.485858:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e62dcb8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5856:1875173761352960:0@lo:502: 00000100:00100000:3.0:1788305134.485949:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305134.486009:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086da4122 going to sleep for 11 seconds 00000100:00100000:2.0:1788305134.486155:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761352960 00000100:00100000:2.0:1788305134.486161:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761352960 00000100:00100000:2.0:1788305134.486208:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305134.486218:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a831c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5856:x1875173761352960:12345-0@lo:502: 00000100:00100000:2.0:1788305134.486566:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a831c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5856:x1875173761352960:12345-0@lo:502: Request processed in 349us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.486576:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305134.486628:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e62dcb8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5856:1875173761352960:0@lo:502: 00000020:01000000:2.0:1788305134.486654:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305134.486659:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305134.486661:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788305134.486663:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788305134.487206:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788305134.487225:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788305134.487243:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487253:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000121bf25a/0x902a3611c9ae81bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305134.487260:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fb8951b000 from 1 10000000:01000000:3.0:1788305134.487263:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305134.487352:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487360:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487369:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305134.487384:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fe88fa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353088:0@lo:101: 00000100:00100000:3.0:1788305134.487488:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305134.487526:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086da4122 going to sleep for 11 seconds 00000100:00100000:3.0:1788305134.487545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353088 00000100:00100000:3.0:1788305134.487550:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353088 00000100:00100000:3.0:1788305134.487575:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305134.487582:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9462403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:5814:x1875173761353088:12345-0@lo:101: 00010000:00010000:3.0:1788305134.487591:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305134.487602:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8211 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487622:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487630:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487637:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ea1c8b0, rc 0) 00000100:00100000:3.0:1788305134.487667:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9462403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+10:5814:x1875173761353088:12345-0@lo:101: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305134.487672:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305134.487702:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fe88fa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353088:0@lo:101: 00010000:00010000:3.0:1788305134.487712:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.487719:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305134.488802:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fe88fa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353216:0@lo:256: 00000100:00100000:3.0:1788305134.488837:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305134.488895:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086da4122 going to sleep for 11 seconds 00000100:00100000:2.0:1788305134.488981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353216 00000100:00100000:2.0:1788305134.488986:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353216 00000100:00100000:2.0:1788305134.489075:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305134.489082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000872002ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+10:5814:x1875173761353216:12345-0@lo:256: 20000000:01000000:2.0:1788305134.489095:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788305134.489100:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788305134.489151:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000872002ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+10:5814:x1875173761353216:12345-0@lo:256: Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.489156:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305134.489209:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fe88fa3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353216:0@lo:256: 10000000:01000000:0.0:1788305134.489871:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305134.489949:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.489970:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305134.489975:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fb8951b000 from 1 10000000:01000000:0.0:1788305134.489977:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305134.490000:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.490007:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.490014:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305134.490030:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353344:0@lo:101: 00000100:00100000:0.0:1788305134.490086:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305134.490110:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0aa5a86 going to sleep for 11 seconds 00000100:00100000:2.0:1788305134.490200:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353344 00000100:00100000:2.0:1788305134.490206:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353344 00000100:00100000:2.0:1788305134.490239:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305134.490245:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c02ea69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+10:5814:x1875173761353344:12345-0@lo:101: 00010000:00010000:2.0:1788305134.490255:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305134.490266:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae821f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.490284:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae821f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.490292:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae821f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.490300:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fe8ded3, rc 0) 00000100:00100000:2.0:1788305134.490336:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c02ea69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761353344:12345-0@lo:101: Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.490343:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305134.490382:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353344:0@lo:101: 00010000:00010000:0.0:1788305134.490393:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.490401:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305134.490528:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353472:0@lo:501: 00000100:00100000:0.0:1788305134.490553:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305134.490616:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0aa5a86 going to sleep for 11 seconds 00000100:00100000:2.0:1788305134.490698:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353472 00000100:00100000:2.0:1788305134.490702:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353472 00000100:00100000:2.0:1788305134.490752:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305134.490756:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a549851c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761353472:12345-0@lo:501: 00000100:00100000:2.0:1788305134.491782:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a549851c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761353472:12345-0@lo:501: Request processed in 1024us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.491789:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305134.491858:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353472:0@lo:501: 00000100:00100000:0.0:1788305134.491947:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353600:0@lo:503: 00000100:00100000:0.0:1788305134.491979:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305134.492005:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0aa5a86 going to sleep for 11 seconds 00000100:00100000:3.0:1788305134.492037:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353600 00000100:00100000:3.0:1788305134.492042:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353600 00000100:00100000:3.0:1788305134.492093:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305134.492122:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e8641f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761353600:12345-0@lo:503: 00000040:00080000:2.0:1788305134.492163:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305134.492202:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e8641f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761353600:12345-0@lo:503: Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.492210:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305134.492229:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2024501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353600:0@lo:503: 00000040:00080000:3.0:1788305134.493086:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788305134.493150:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788305134.493169:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305134.493188:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.493198:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305134.493232:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788305134.493234:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96fb8951b000 10000000:01000000:2.0:1788305134.493236:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96fb8951b000 10000000:01000000:2.0:1788305134.493239:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305134.493243:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fb8951b000 from 1 10000000:01000000:2.0:1788305134.493244:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305134.493267:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.493272:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.493278:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305134.493380:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078ecde4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353728:0@lo:101: 00000100:00100000:2.0:1788305134.493488:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305134.493525:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002a8f50e going to sleep for 11 seconds 00000100:00100000:3.0:1788305134.493529:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353728 00000100:00100000:3.0:1788305134.493535:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353728 00000100:00100000:3.0:1788305134.493566:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305134.493573:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6206637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761353728:12345-0@lo:101: 00010000:00010000:3.0:1788305134.493583:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305134.493594:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000896f3da0/0x902a3611c9ae8234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae822d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.493613:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000896f3da0/0x902a3611c9ae8234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae822d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.493621:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000896f3da0/0x902a3611c9ae8234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae822d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305134.493629:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000896f3da0, rc 0) 00000100:00100000:3.0:1788305134.493663:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6206637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5814:x1875173761353728:12345-0@lo:101: Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305134.493668:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305134.493731:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078ecde4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353728:0@lo:101: 00010000:00010000:2.0:1788305134.493741:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.493746:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305134.493778:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078ecde4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353856:0@lo:501: 00000100:00100000:2.0:1788305134.493796:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305134.493811:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002a8f50e going to sleep for 11 seconds 00000100:00100000:0.0:1788305134.493848:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353856 00000100:00100000:0.0:1788305134.493851:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353856 00000100:00100000:0.0:1788305134.493872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305134.493876:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6988a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5814:x1875173761353856:12345-0@lo:501: 00000100:00100000:0.0:1788305134.494103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6988a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5814:x1875173761353856:12345-0@lo:501: Request processed in 226us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305134.494110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305134.494215:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078ecde4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353856:0@lo:501: 00000100:00100000:3.0:1788305134.494241:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003dd2997f pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353984:0@lo:503: 00000100:00100000:3.0:1788305134.494275:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305134.494303:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000293025f2 going to sleep for 11 seconds 00000100:00100000:2.0:1788305134.494368:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761353984 00000100:00100000:2.0:1788305134.494372:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761353984 00000100:00100000:2.0:1788305134.494514:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305134.494523:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b437fdf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5814:x1875173761353984:12345-0@lo:503: 00000100:00100000:2.0:1788305134.494791:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b437fdf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5814:x1875173761353984:12345-0@lo:503: Request processed in 270us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.494796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305134.494859:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003dd2997f pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761353984:0@lo:503: 00000100:00100000:1.0:1788305134.495592:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5861:1875173761354112:0@lo:502: 00000100:00100000:1.0:1788305134.495627:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305134.495658:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013edada6 going to sleep for 11 seconds 00000100:00100000:2.0:1788305134.495712:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354112 00000100:00100000:2.0:1788305134.495718:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354112 00000100:00100000:2.0:1788305134.495744:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305134.495752:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df5aa610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5861:x1875173761354112:12345-0@lo:502: 00000100:00100000:2.0:1788305134.495963:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df5aa610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5861:x1875173761354112:12345-0@lo:502: Request processed in 212us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.495970:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305134.495987:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5861:1875173761354112:0@lo:502: 00000020:01000004:1.0:1788305134.496045:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788305134.496099:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000fda738f0) 00000020:00000080:1.0:1788305134.496117:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788305134.496176:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000032d4ca7b from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788305134.496179:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000032d4ca7b from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788305134.496180:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000032d4ca7b 4 00010000:00080000:1.0:1788305134.496201:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004bafb66b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788305134.497536:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788305134.497702:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788305134.497729:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788305134.497740:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x902a3611c9ae8242 00000100:00080000:1.0:1788305134.497749:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305134.497753:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004bafb66b using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305134.497782:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cc177bb1 x1875173761354240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305134.497808:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305134.497927:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761354240:0@lo:38: 00000100:00100000:3.0:1788305134.497988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305134.498043:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354240 00000100:00100000:0.0:1788305134.498050:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354240 00000100:00100000:0.0:1788305134.498100:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305134.498106:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb58ae69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875173761354240:12345-0@lo:38: 00000100:00100000:0.0:1788305134.498153:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb58ae69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875173761354240:12345-0@lo:38: Request processed in 46us (165us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788305134.498159:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305134.498230:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305134.498238:0:3300:0:(import.c:65:import_set_state_nolock()) 000000004bafb66b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305134.498242:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788305134.498245:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761354240:0@lo:38: 00000100:00100000:3.0:1788305134.498617:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b03af1db pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5861:1875173761354368:0@lo:502: 00000100:00100000:3.0:1788305134.498660:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305134.498690:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000293025f2 going to sleep for 11 seconds 00000100:00100000:0.0:1788305134.498712:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354368 00000100:00100000:0.0:1788305134.498717:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354368 00000100:00100000:0.0:1788305134.498759:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305134.498766:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000838cf651 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5861:x1875173761354368:12345-0@lo:502: 00000100:00100000:0.0:1788305134.498969:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000838cf651 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5861:x1875173761354368:12345-0@lo:502: Request processed in 204us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305134.498977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305134.499075:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b03af1db pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:5861:1875173761354368:0@lo:502: 00000040:00080000:3.0:1788305134.499096:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788305134.499149:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788305134.499173:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305134.499191:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.499201:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 0000000019e4ae77/0x902a3611c9ae822d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305134.499250:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305134.499252:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305134.499254:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305134.499255:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305134.499256:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305134.499258:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305134.499259:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305134.499260:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305134.499262:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305134.499263:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305134.499264:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305134.499266:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305134.499269:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788305134.499271:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305134.499273:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305134.499274:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305134.499275:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305134.499276:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305134.499277:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305134.499278:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305134.499279:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305134.499280:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305134.499280:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305134.499281:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305134.499282:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305134.499296:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788305134.499304:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761354496:0@lo:253: 00000100:00100000:1.0:1788305134.499334:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305134.499372:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354496 00000100:00100000:1.0:1788305134.499373:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e33a87a4 going to sleep for 11 seconds 00000100:00100000:3.0:1788305134.499376:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354496 00000100:00100000:3.0:1788305134.499407:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788305134.499423:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed8474bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5814:x1875173761354496:12345-0@lo:253: 20000000:01000000:3.0:1788305134.499448:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788305134.499461:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788305134.533770:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788305134.533836:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788305134.533899:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788305134.533904:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788305134.533924:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.533943:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.533964:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.534003:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.534018:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 12 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305134.534032:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3e99296 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875173761354624:0@lo:104: 00000100:00100000:1.0:1788305134.534186:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305134.534339:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354624 00000100:00100000:0.0:1788305134.534347:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354624 00000100:00100000:1.0:1788305134.534375:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7349d62 going to sleep for 11 seconds 00000100:00100000:0.0:1788305134.534392:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305134.534400:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ea8bbb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5848:x1875173761354624:12345-0@lo:104: 00010000:00010000:0.0:1788305134.534422:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.534492:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305134.534497:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ea8bbb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5848:x1875173761354624:12345-0@lo:104: Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305134.534504:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788305134.534523:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305134.534528:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.534535:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3a472ac already unused, calling callback (00000000e940ada0) 10000000:00010000:0.0:1788305134.534537:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305134.534543:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3e99296 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875173761354624:0@lo:104: 00010000:00010000:0.0:1788305134.534544:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305134.534550:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305134.534555:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305134.534559:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.534584:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.534591:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305134.534610:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.534627:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 00000000a3a472ac/0x902a3611c9ae8211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8218 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305134.534641:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305134.534654:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305134.534656:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305134.534683:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3bea3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761354752:0@lo:103: 00000100:00100000:1.0:1788305134.534710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305134.534807:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354752 00000100:00100000:2.0:1788305134.534817:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354752 00010000:00010000:2.0:1788305134.534834:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 13 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305134.534863:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305134.534869:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e99296 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3302:x1875173761354752:12345-0@lo:103: 00010000:00010000:2.0:1788305134.534879:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305134.534883:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 13 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534892:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 13 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534904:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ea1c8b0/0x902a3611c9ae8218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8211 expref: 13 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534914:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534921:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788305134.534932:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001029403s 00010000:00010000:2.0:1788305134.534935:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534941:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534946:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534960:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534965:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ba68b74 already unused, calling callback (00000000d7cc4453) 00010000:00010000:2.0:1788305134.534968:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.534974:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.535108:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305134.535115:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.535145:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.535152:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ba68b74/0x902a3611c9ae8249 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305134.535165:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305134.535196:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e99296 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3302:x1875173761354752:12345-0@lo:103: Request processed in 327us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.535202:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305134.535231:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3bea3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761354752:0@lo:103: 00000100:00100000:2.0:1788305134.539595:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed8474bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5814:x1875173761354496:12345-0@lo:253: Request processed in 40165us (40253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305134.539611:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305134.539754:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:5814:1875173761354496:0@lo:253: 10000000:01000000:1.0:1788305134.539770:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788305134.539774:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305134.539792:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305134.539793:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305134.539794:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305134.539795:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305134.539797:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305134.539798:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305134.539799:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305134.539801:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305134.539802:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305134.539803:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305134.539804:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788305134.539820:0:5814:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788305134.550280:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.550687:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305134.550883:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.551107:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305134.551306:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.551494:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305134.557192:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.558188:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305134.560754:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.562189:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305134.562593:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305134.562765:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788305134.600636:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788305134.628894:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788305134.629203:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788305134.631646:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788305134.631787:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788305134.632272:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788305134.632279:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788305134.632389:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788305134.633842:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788305134.633850:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788305134.645009:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788305134.645849:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788305134.645885:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788305134.646462:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788305134.646824:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788305134.648135:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788305134.648282:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788305134.648781:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788305134.648951:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788305134.649496:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788305134.649806:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788305134.649948:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788305134.650195:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788305134.650335:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788305134.650823:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788305134.650989:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788305134.651948:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788305134.652132:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788305134.652285:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788305134.652513:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788305134.652817:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788305134.653205:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788305134.653401:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788305134.653785:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788305134.653942:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788305134.654164:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788305134.654334:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788305134.654566:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788305134.654917:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788305134.655085:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788305134.655233:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788305134.655384:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788305134.655773:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788305134.655933:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788305134.656148:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788305134.656285:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788305134.656587:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788305134.658958:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788305134.679969:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305134.721145:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788305134.721226:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788305134.721231:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788305134.721738:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788305134.721760:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb81141db7988 00100000:10000000:2.0:1788305134.721767:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788305134.722530:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788305134.722544:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788305134.722558:0:5814:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788305134.722584:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788305135.473966:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305136.515765:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305137.522391:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305138.545218:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788305138.927263:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788305139.570420:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305139.956368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788305139.956375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305139.956385:0:36:0:(import.c:65:import_set_state_nolock()) 000000004bafb66b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305139.956397:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004bafb66b using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305139.956421:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dcbc5e70 x1875173761355008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305139.956490:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305139.956504:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761354880:0@lo:400: 00000100:00100000:1.0:1788305139.956582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305139.956634:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcbc5e70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761355008:0@lo:38: 00000100:00100000:1.0:1788305139.956865:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305139.956900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761354880 00000100:00100000:1.0:1788305139.956907:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761354880 00000100:00100000:1.0:1788305139.956948:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305139.956956:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c945927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3304:x1875173761354880:12345-0@lo:400: 00000100:00100000:1.0:1788305139.957005:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c945927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3304:x1875173761354880:12345-0@lo:400: Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305139.957012:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305139.957073:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761354880:0@lo:400: 00000100:00100000:3.0:1788305139.957720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355008 00000100:00100000:3.0:1788305139.957726:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355008 00000100:00100000:3.0:1788305139.957750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305139.957754:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084813a84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1875173761355008:12345-0@lo:38: 00010000:00080000:3.0:1788305139.957776:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1788305139.957817:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x902a3611c9ae8250 00000004:00100000:3.0:1788305139.957857:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788305139.957961:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000982e3d3e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305139.958015:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084813a84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875173761355008:12345-0@lo:38: Request processed in 259us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305139.958021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305139.958072:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dcbc5e70 x1875173761355008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305139.958086:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788305139.958092:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788305139.958096:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788305139.958098:0:3300:0:(import.c:65:import_set_state_nolock()) 000000004bafb66b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788305139.958103:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcbc5e70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761355008:0@lo:38: 00010000:00010000:0.0:1788305140.593664:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305141.617177:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788305142.513179:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788305142.513187:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fb8951b000 from 3 10000000:01000000:2.0:1788305142.513192:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305142.513241:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305142.513264:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305142.513963:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305142.513991:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f361c81b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761355136:0@lo:101: 00000100:00100000:2.0:1788305142.514135:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305142.514192:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fe4d0e51 going to sleep for 11 seconds 00000100:00100000:3.0:1788305142.514596:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355136 00000100:00100000:3.0:1788305142.514606:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355136 00000100:00100000:3.0:1788305142.514652:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305142.514659:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ceeabe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5830:x1875173761355136:12345-0@lo:101: 00010000:00010000:3.0:1788305142.514673:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305142.514688:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd21cfb8/0x902a3611c9ae825e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305142.514711:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd21cfb8/0x902a3611c9ae825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305142.514722:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd21cfb8/0x902a3611c9ae825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305142.514730:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd21cfb8, rc 0) 00000100:00100000:3.0:1788305142.514789:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ceeabe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761355136:12345-0@lo:101: Request processed in 130us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305142.514796:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305142.515427:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f361c81b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761355136:0@lo:101: 00010000:00010000:2.0:1788305142.515442:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305142.515451:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305142.515515:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f361c81b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761355264:0@lo:256: 00000100:00100000:2.0:1788305142.515553:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305142.515587:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fe4d0e51 going to sleep for 11 seconds 00000100:00100000:1.0:1788305142.515752:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355264 00000100:00100000:1.0:1788305142.515758:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355264 00000100:00100000:1.0:1788305142.515791:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305142.515798:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc4e109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761355264:12345-0@lo:256: 20000000:01000000:1.0:1788305142.515813:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305142.515828:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305142.515843:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788305142.515928:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc4e109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761355264:12345-0@lo:256: Request processed in 131us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305142.515935:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305142.516696:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f361c81b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761355264:0@lo:256: 10000000:01000000:2.0:1788305142.516742:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305142.516754:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305142.516762:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 0000000041cc7f49/0x902a3611c9ae8257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305142.642263:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305143.666197:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788305143.948744:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6c5607e0 20000000:00000080:0.0:1788305143.948763:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fb83174800 uarg=0000000000000000 20000000:01000000:0.0:1788305143.948803:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788305143.948810:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788305143.948814:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788305143.948990:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788305143.949001:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788305143.956565:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305143.957808:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788305143.957875:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788305143.957928:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788305143.957945:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305143.957960:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305143.957974:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae821f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305143.957979:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305143.958013:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae821f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305143.958023:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae821f expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305143.958035:0:6312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f361c81b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1875173761355392:0@lo:104: 00000100:00100000:2.0:1788305143.958415:0:6312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305143.958468:0:6312:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7e63a1f going to sleep for 11 seconds 00000100:00100000:1.0:1788305143.959178:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355392 00000100:00100000:1.0:1788305143.959188:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355392 00000100:00100000:1.0:1788305143.959397:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305143.959407:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fdf1d28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:6312:x1875173761355392:12345-0@lo:104: 00010000:00010000:1.0:1788305143.959423:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.959669:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305143.959674:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fdf1d28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:6312:x1875173761355392:12345-0@lo:104: Request processed in 270us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305143.959682:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788305143.959704:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305143.959709:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.959716:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b1009a6 already unused, calling callback (00000000e940ada0) 10000000:00010000:1.0:1788305143.959719:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.959726:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305143.959731:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305143.959736:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305143.959765:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.959771:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305143.959797:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.959803:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000009b1009a6/0x902a3611c9ae821f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8226 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.959821:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305143.959823:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305143.959825:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305143.959841:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761355520:0@lo:103: 00000100:00100000:1.0:1788305143.959880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305143.959935:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355520 00000100:00100000:1.0:1788305143.959939:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355520 00010000:00010000:1.0:1788305143.959958:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae821f expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305143.959980:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305143.959986:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d95465ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3304:x1875173761355520:12345-0@lo:103: 00010000:00010000:1.0:1788305143.959996:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305143.960001:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae821f expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960011:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae821f expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960027:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960034:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960085:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960092:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960097:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960103:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960108:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012826805 already unused, calling callback (00000000d7cc4453) 00010000:00010000:1.0:1788305143.960111:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960117:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960366:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305143.960378:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305143.960412:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d95465ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3304:x1875173761355520:12345-0@lo:103: Request processed in 427us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305143.960419:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305143.960453:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc177bb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761355520:0@lo:103: 00010000:00010000:3.0:1788305143.963743:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fe8ded3/0x902a3611c9ae8226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae821f expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305143.963768:0:6312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f361c81b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1875173761355392:0@lo:104: 00010000:00010000:3.0:1788305143.963792:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305143.963802:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305143.963807:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305143.963812:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012826805/0x902a3611c9ae8265 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305144.690165:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305145.073448:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761355776:0@lo:400: 00000100:00100000:1.0:1788305145.073532:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305145.073622:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305145.073629:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000000bec3d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761355648:0@lo:400: 00000100:00100000:1.0:1788305145.073658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305145.073695:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355648 00000100:00100000:1.0:1788305145.073702:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355648 00000100:00100000:1.0:1788305145.073747:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305145.073757:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87ff231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3302:x1875173761355648:12345-0@lo:400: 00000100:00100000:1.0:1788305145.073824:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87ff231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3302:x1875173761355648:12345-0@lo:400: Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305145.073832:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305145.073879:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000000bec3d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761355648:0@lo:400: 00000100:00100000:2.0:1788305145.074018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355776 00000100:00100000:2.0:1788305145.074024:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355776 00000100:00100000:2.0:1788305145.074080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305145.074087:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc177bb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761355776:12345-0@lo:400: 00000100:00100000:2.0:1788305145.074128:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc177bb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761355776:12345-0@lo:400: Request processed in 42us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305145.074133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788305145.074164:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009c24cfd8 x1875173761355776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305145.074176:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761355776:0@lo:400: 00010000:00010000:0.0:1788305145.714535:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305146.737661:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305147.761697:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305148.785445:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305149.809219:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305150.194319:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ec2e6c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761355904:0@lo:400: 00000100:00100000:1.0:1788305150.194400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305150.194455:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305150.194460:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051099dc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761356032:0@lo:400: 00000100:00100000:1.0:1788305150.194483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305150.194564:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761355904 00000100:00100000:3.0:1788305150.194572:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761355904 00000100:00100000:3.0:1788305150.194616:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305150.194624:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d1f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3303:x1875173761355904:12345-0@lo:400: 00000100:00100000:3.0:1788305150.194680:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d1f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3303:x1875173761355904:12345-0@lo:400: Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305150.194687:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305150.194719:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356032 00000100:00100000:3.0:1788305150.194723:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356032 00000100:00100000:3.0:1788305150.194763:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305150.194769:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c7e9d98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761356032:12345-0@lo:400: 00000100:00100000:3.0:1788305150.194800:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c7e9d98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761356032:12345-0@lo:400: Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305150.194805:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305150.194840:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000051099dc6 x1875173761356032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305150.194855:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051099dc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761356032:0@lo:400: 00000100:00100000:3.0:1788305150.194865:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ec2e6c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761355904:0@lo:400: 10000000:01000000:2.0:1788305150.195438:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305150.195444:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fb8951b000 from 1 10000000:01000000:2.0:1788305150.195448:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305150.195479:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000004dedfa8d/0x902a3611c9ae826c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305150.195489:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000004dedfa8d/0x902a3611c9ae826c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305150.195498:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000004dedfa8d/0x902a3611c9ae826c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305150.195514:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761356160:0@lo:101: 00000100:00100000:2.0:1788305150.195547:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305150.195575:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073015bfd going to sleep for 11 seconds 00000100:00100000:1.0:1788305150.195850:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356160 00000100:00100000:1.0:1788305150.195856:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356160 00000100:00100000:1.0:1788305150.195945:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305150.195953:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf0f1ad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:5830:x1875173761356160:12345-0@lo:101: 00010000:00010000:1.0:1788305150.195964:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305150.195980:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dbc7f56f/0x902a3611c9ae8273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae826c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305150.196002:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbc7f56f/0x902a3611c9ae8273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae826c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305150.196012:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dbc7f56f/0x902a3611c9ae8273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae826c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305150.196029:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dbc7f56f, rc 0) 00000100:00100000:1.0:1788305150.196085:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf0f1ad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761356160:12345-0@lo:101: Request processed in 134us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305150.196092:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305150.196171:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761356160:0@lo:101: 00010000:00010000:2.0:1788305150.196184:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000004dedfa8d/0x902a3611c9ae826c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305150.196202:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000004dedfa8d/0x902a3611c9ae826c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305150.196250:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761356288:0@lo:501: 00000100:00100000:2.0:1788305150.196275:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305150.196937:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073015bfd going to sleep for 11 seconds 00000100:00100000:3.0:1788305150.197026:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356288 00000100:00100000:3.0:1788305150.197033:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356288 00000100:00100000:3.0:1788305150.197194:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305150.197203:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000377dcb4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761356288:12345-0@lo:501: 00000100:00100000:3.0:1788305150.197597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000377dcb4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761356288:12345-0@lo:501: Request processed in 394us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305150.197604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305150.197770:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761356288:0@lo:501: 00000100:00100000:2.0:1788305150.197814:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761356416:0@lo:503: 00000100:00100000:2.0:1788305150.197859:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305150.197888:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073015bfd going to sleep for 11 seconds 00000100:00100000:3.0:1788305150.197945:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356416 00000100:00100000:3.0:1788305150.197950:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356416 00000100:00100000:3.0:1788305150.197972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788305150.197978:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d76eccf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761356416:12345-0@lo:503: 00000100:00100000:3.0:1788305150.198778:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d76eccf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761356416:12345-0@lo:503: Request processed in 798us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305150.198787:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305150.198865:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c24cfd8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761356416:0@lo:503: 00000100:00100000:1.0:1788305150.199352:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095314c90 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6651:1875173761356544:0@lo:502: 00000100:00100000:1.0:1788305150.199405:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305150.199441:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a23a633 going to sleep for 11 seconds 00000100:00100000:3.0:1788305150.199541:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356544 00000100:00100000:3.0:1788305150.199547:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356544 00000100:00100000:3.0:1788305150.199585:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305150.199600:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc8ddb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6651:x1875173761356544:12345-0@lo:502: 00000100:00100000:3.0:1788305150.199775:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc8ddb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6651:x1875173761356544:12345-0@lo:502: Request processed in 176us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305150.199782:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305150.199865:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095314c90 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6651:1875173761356544:0@lo:502: 00000020:01000000:1.0:1788305150.199888:0:6651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305150.199896:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305150.199898:0:6651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788305150.199904:0:6651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fb8951b000 00000020:00000080:1.0:1788305150.199907:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788305150.199948:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6651:1875173761356672:0@lo:502: 00000100:00100000:1.0:1788305150.199980:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305150.200215:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb985800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305150.200372:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356672 00000100:00100000:0.0:1788305150.200441:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356672 00000100:00100000:3.0:1788305150.200502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788305150.200512:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6651:x1875173761356672:12345-0@lo:502: 00000100:00100000:3.0:1788305150.200647:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6651:x1875173761356672:12345-0@lo:502: Request processed in 137us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305150.200655:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788305150.200734:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6651:1875173761356672:0@lo:502: 00000020:01000000:1.0:1788305150.200753:0:6651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305150.200758:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305150.200760:0:6651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788305150.200764:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788305150.200913:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788305150.200931:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305150.200940:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305150.200951:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788305150.776030:0:6673:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788305150.776251:0:6673:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788305150.776623:0:6673:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96fbb95e7800 00000020:01000004:2.0:1788305150.776641:0:6673:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788305150.776653:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788305150.776667:0:6673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96fba0523370) 00000020:00000080:2.0:1788305150.776683:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788305150.804771:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788305150.805004:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788305150.823527:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788305150.828557:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788305150.828591:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788305150.828660:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788305150.828686:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788305150.829036:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788305150.829046:0:6673:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788305150.829156:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x902a3611c9ae8281 00000020:01000004:1.0:1788305150.829165:0:6673:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788305150.829187:0:6673:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788305150.829190:0:6673:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788305150.829197:0:6673:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788305150.829201:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788305150.829212:0:6673:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96fb90f499b8) 00000020:00000080:1.0:1788305150.829222:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788305150.830295:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305150.830454:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788305150.830459:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788305150.833674:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788305150.833687:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788305150.842096:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788305150.842109:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00010000:00010000:0.0:1788305150.842200:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305150.846926:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305150.848885:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788305150.848896:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788305150.850188:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305150.850199:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788305150.885703:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305150.885944:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788305150.885952:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788305150.889509:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788305150.889524:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788305150.890651:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788305150.890660:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788305150.892713:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305150.892904:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788305150.892910:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788305150.897963:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788305150.897978:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788305150.966996:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305150.968335:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788305150.968343:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788305150.970763:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788305150.970778:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788305150.982470:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788305150.982508:0:6673:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788305150.982515:0:6673:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788305151.013338:0:6673:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788305151.013387:0:6673:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788305151.013392:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788305151.013394:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305151.013399:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305151.013400:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305151.013401:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305151.013403:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305151.013404:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305151.013406:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305151.013407:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305151.013408:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305151.013410:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788305151.013414:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788305151.013416:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305151.013417:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305151.013418:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305151.013419:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305151.013420:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305151.013421:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305151.013421:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305151.013422:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305151.013423:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305151.013424:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305151.013425:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788305151.013466:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788305151.013488:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761356800:0@lo:253: 00000100:00100000:1.0:1788305151.013564:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.014313:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305151.014493:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356800 00000100:00100000:3.0:1788305151.014501:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356800 00000100:00100000:3.0:1788305151.014558:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305151.014568:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761356800:12345-0@lo:253: 20000000:01000000:3.0:1788305151.014600:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788305151.014605:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788305151.014610:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788305151.014613:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788305151.015513:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305151.015724:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788305151.015738:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788305151.015776:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788305151.015784:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788305151.015815:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788305151.015863:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788305151.016225:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788305151.016245:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:3.0:1788305151.016247:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:3.0:1788305151.016282:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788305151.016291:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788305151.016354:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788305151.016362:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:3.0:1788305151.017294:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788305151.017312:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788305151.017360:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788305151.017424:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788305151.020862:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788305151.020897:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:2.0:1788305151.020899:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:2.0:1788305151.020938:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788305151.020945:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788305151.020975:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788305151.020982:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:2.0:1788305151.021025:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788305151.021047:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788305151.021115:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788305151.021162:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788305151.021180:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788305151.021183:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788305151.021187:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788305151.021200:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788305151.021202:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788305151.021236:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788305151.021239:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788305151.021760:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788305151.021809:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788305151.021857:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788305151.022416:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788305151.022462:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788305151.022497:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788305151.022509:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788305151.022511:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788305151.024829:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788305151.025249:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788305151.025298:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788305151.025384:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788305151.025398:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788305151.025401:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788305151.031731:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788305151.031818:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788305151.031879:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788305151.032264:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788305151.032307:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788305151.032365:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788305151.032382:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788305151.032385:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788305151.032393:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788305151.032411:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032429:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032437:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032462:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae822d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032470:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032508:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae822d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032522:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae822d expref: 12 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305151.032537:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875173761356928:0@lo:104: 00000100:00100000:2.0:1788305151.032595:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305151.032721:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.032730:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 12 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305151.032738:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875173761357056:0@lo:104: 00000100:00100000:2.0:1788305151.032762:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305151.033704:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.033715:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 12 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305151.033724:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875173761357184:0@lo:104: 00000100:00100000:2.0:1788305151.033761:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.041239:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761356928 00000100:00100000:3.0:1788305151.041256:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761356928 00000100:00100000:3.0:1788305151.041314:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357056 00000100:00100000:3.0:1788305151.041330:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357056 00000100:00100000:3.0:1788305151.041351:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305151.041361:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+4:5827:x1875173761356928:12345-0@lo:104: 00010000:00010000:3.0:1788305151.041377:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.041480:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305151.041487:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+4:5827:x1875173761356928:12345-0@lo:104: Request processed in 128us (8892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.041494:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305151.041512:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305151.041518:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5827:x1875173761357056:12345-0@lo:104: 00010000:00010000:3.0:1788305151.041526:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.041561:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788305151.041567:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5827:x1875173761357056:12345-0@lo:104: Request processed in 50us (8804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.041573:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305151.044100:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87feb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305151.044138:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875173761356928:0@lo:104: 00000100:00100000:2.0:1788305151.044163:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875173761357056:0@lo:104: 00000100:00100000:3.0:1788305151.047774:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357184 00000100:00100000:3.0:1788305151.047790:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357184 00000100:00100000:3.0:1788305151.047844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305151.047854:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5827:x1875173761357184:12345-0@lo:104: 00010000:00010000:3.0:1788305151.047871:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.047965:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788305151.047972:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5827:x1875173761357184:12345-0@lo:104: Request processed in 120us (14210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.047992:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305151.048321:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875173761357184:0@lo:104: 00010000:00010000:2.0:1788305151.048350:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050017:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788305151.050027:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050257:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7de00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305151.050262:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050272:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305151.050280:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305151.050286:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305151.050416:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050423:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305151.050469:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050477:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae822d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8234 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050492:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305151.050495:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050501:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305151.050504:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.050511:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305151.050517:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305151.050522:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788305151.050568:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761357312:0@lo:103: 00000100:00100000:2.0:1788305151.050634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.050777:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357312 00000100:00100000:1.0:1788305151.050785:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357312 00010000:00010000:1.0:1788305151.050816:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae822d expref: 13 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.050905:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305151.050915:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3301:x1875173761357312:12345-0@lo:103: 00010000:00010000:1.0:1788305151.050928:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305151.050935:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae822d expref: 13 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.050945:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae822d expref: 13 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.050962:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae822d expref: 13 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.050976:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305151.051013:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3301:x1875173761357312:12345-0@lo:103: Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.051021:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788305151.057120:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057135:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305151.057158:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057166:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd400/0x902a3611c9ae81bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae81c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057183:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305151.057205:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057212:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd800 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305151.057215:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057225:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305151.057232:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305151.057238:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305151.057255:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057262:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305151.057280:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057286:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fd800/0x902a3611c9ae81a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae81a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057299:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305151.057306:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305151.057308:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305151.057315:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305151.057333:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761357440:0@lo:103: 00000100:00100000:0.0:1788305151.057399:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305151.057461:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761357568:0@lo:103: 00000100:00100000:0.0:1788305151.057492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305151.057529:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357440 00000100:00100000:0.0:1788305151.057536:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357440 00010000:00010000:0.0:1788305151.057560:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 12 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305151.057577:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357568 00000100:00100000:0.0:1788305151.057580:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357568 00010000:00010000:0.0:1788305151.057591:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 13 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305151.057604:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305151.057612:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3302:x1875173761357440:12345-0@lo:103: 00010000:00010000:0.0:1788305151.057624:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305151.057630:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 13 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057642:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 13 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057656:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae81c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae81bd expref: 13 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057670:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305151.057704:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3302:x1875173761357440:12345-0@lo:103: Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.057710:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305151.057725:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305151.057731:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3303:x1875173761357568:12345-0@lo:103: 00010000:00010000:0.0:1788305151.057738:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305151.057749:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057758:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057767:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae81a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae81a1 expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057778:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057786:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057800:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057807:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057813:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057819:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057824:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305151.057828:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057835:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057855:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057866:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305151.057893:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+10:3303:x1875173761357568:12345-0@lo:103: Request processed in 162us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.057900:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305151.057933:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761357440:0@lo:103: 00000100:00100000:0.0:1788305151.057958:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761357568:0@lo:103: 00010000:00010000:0.0:1788305151.057983:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057991:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.057998:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7c800/0x902a3611c9ae828f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305151.058010:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788305151.060838:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761357312:0@lo:103: 00000100:00100000:1.0:1788305151.118882:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+9:6673:x1875173761356800:12345-0@lo:253: Request processed in 104305us (105308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.118898:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305151.119012:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761356800:0@lo:253: 10000000:01000000:0.0:1788305151.119027:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788305151.119161:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305151.119164:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305151.119166:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305151.119167:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788305151.119168:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305151.119170:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305151.119171:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305151.119173:0:6673:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788305151.119189:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305151.119191:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788305151.119212:0:6673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96fbb95e7800 from lustre-OST0000 10000000:01000000:0.0:1788305151.119240:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788305151.119244:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788305151.119250:0:6673:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96fba05219b8 local copy 10000000:01000000:0.0:1788305151.119254:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305151.119291:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.119301:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.119310:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305151.119327:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761357696:0@lo:101: 00000100:00100000:0.0:1788305151.119432:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305151.119518:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90f38d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.119579:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357696 00000100:00100000:1.0:1788305151.119587:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357696 00000100:00100000:1.0:1788305151.119634:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305151.119644:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+9:6673:x1875173761357696:12345-0@lo:101: 00010000:00010000:1.0:1788305151.119657:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305151.119671:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fc000/0x902a3611c9ae829d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8296 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.119707:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fc000/0x902a3611c9ae829d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8296 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.119719:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fc000/0x902a3611c9ae829d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8296 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.119729:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc000, rc 0) 00000100:00100000:1.0:1788305151.119762:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+10:6673:x1875173761357696:12345-0@lo:101: Request processed in 120us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.119768:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305151.119957:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761357696:0@lo:101: 00010000:00010000:2.0:1788305151.119971:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.119980:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305151.120342:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761357824:0@lo:501: 00000100:00100000:3.0:1788305151.120457:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.120531:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.120571:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357824 00000100:00100000:1.0:1788305151.120577:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357824 00000100:00100000:1.0:1788305151.120646:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305151.120656:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+10:6673:x1875173761357824:12345-0@lo:501: 00000100:00100000:1.0:1788305151.120856:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+10:6673:x1875173761357824:12345-0@lo:501: Request processed in 201us (398us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305151.120864:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305151.120929:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761357824:0@lo:501: 10000000:01000000:3.0:1788305151.120943:0:6673:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788305151.120971:0:6673:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788305151.120976:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.120986:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.120993:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.121020:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788305151.121071:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96fbb95e7800 10000000:01000000:3.0:1788305151.121077:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788305151.121082:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96fba05219b8 10000000:01000000:3.0:1788305151.121084:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788305151.121087:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96fba05219b8 from 1 10000000:01000000:3.0:1788305151.121090:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788305151.121109:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.121116:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.121136:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305151.121160:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761357952:0@lo:101: 00000100:00100000:3.0:1788305151.121187:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305151.121262:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305151.121269:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.121276:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031e00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305151.121279:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.121287:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305151.121306:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305151.121312:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305151.121331:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.121336:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305151.121353:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.121372:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae8296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x902a3611c9ae829d expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.121387:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305151.121389:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305151.121391:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305151.121681:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305151.121757:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761357952 00000100:00100000:0.0:1788305151.121763:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761357952 00000100:00100000:0.0:1788305151.121790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305151.121797:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+10:6673:x1875173761357952:12345-0@lo:101: 00010000:00010000:0.0:1788305151.121808:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305151.121821:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031200/0x902a3611c9ae82ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae82a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.121839:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031200/0x902a3611c9ae82ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae82a4 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.121849:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031200/0x902a3611c9ae82ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82a4 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.121863:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031200, rc 0) 00000100:00100000:0.0:1788305151.121905:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761357952:12345-0@lo:101: Request processed in 108us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.121910:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305151.121942:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761358080:0@lo:103: 00000100:00100000:0.0:1788305151.121968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305151.122005:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358080 00000100:00100000:0.0:1788305151.122008:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358080 00000100:00100000:3.0:1788305151.122185:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761357952:0@lo:101: 00010000:00010000:3.0:1788305151.122198:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.122205:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305151.122221:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788305151.122232:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.122239:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305151.122246:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788305151.122251:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305151.122255:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788305151.122257:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788305151.122273:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.122280:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.122295:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305151.122307:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358208:0@lo:101: 00000100:00100000:3.0:1788305151.122334:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.122354:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305151.122487:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305151.122495:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:3304:x1875173761358080:12345-0@lo:103: 00010000:00010000:0.0:1788305151.122505:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305151.122518:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fc000/0x902a3611c9ae829d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae8296 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.122531:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305151.122560:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+10:3304:x1875173761358080:12345-0@lo:103: Request processed in 66us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.122566:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305151.122588:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358208 00000100:00100000:0.0:1788305151.122592:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358208 00000100:00100000:0.0:1788305151.122609:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305151.122616:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+10:6673:x1875173761358208:12345-0@lo:101: 00010000:00010000:0.0:1788305151.122623:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305151.122632:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae82b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.122645:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.122661:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.122668:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030a00, rc 0) 00000100:00100000:0.0:1788305151.122693:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358208:12345-0@lo:101: Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.122699:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305151.122773:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761358080:0@lo:103: 00000100:00100000:3.0:1788305151.122799:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358208:0@lo:101: 00010000:00010000:3.0:1788305151.122808:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.122816:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305151.122898:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358336:0@lo:501: 00000100:00100000:3.0:1788305151.122922:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.122945:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305151.122994:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358336 00000100:00100000:0.0:1788305151.122999:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358336 00000100:00100000:0.0:1788305151.123016:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305151.123022:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358336:12345-0@lo:501: 00000100:00100000:0.0:1788305151.123280:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358336:12345-0@lo:501: Request processed in 257us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.123287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305151.123471:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358336:0@lo:501: 00000100:00100000:3.0:1788305151.123498:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358464:0@lo:503: 00000100:00100000:3.0:1788305151.123538:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.123565:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305151.123624:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358464 00000100:00100000:0.0:1788305151.123628:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358464 00000100:00100000:0.0:1788305151.123646:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305151.123651:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358464:12345-0@lo:503: 00000100:00100000:0.0:1788305151.123837:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358464:12345-0@lo:503: Request processed in 184us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.123844:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305151.124023:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358464:0@lo:503: 00000040:00080000:3.0:1788305151.124650:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305151.124719:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358592:0@lo:502: 00000100:00100000:3.0:1788305151.124766:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.124838:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305151.124888:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358592 00000100:00100000:0.0:1788305151.124895:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358592 00000100:00100000:0.0:1788305151.124973:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305151.124983:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358592:12345-0@lo:502: 00000100:00100000:0.0:1788305151.125204:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358592:12345-0@lo:502: Request processed in 223us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.125216:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305151.125291:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358592:0@lo:502: 00000040:00080000:3.0:1788305151.125564:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788305151.125617:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788305151.125653:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788305151.125703:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788305151.125738:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788305151.125772:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788305151.125798:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358720:0@lo:502: 00000100:00100000:3.0:1788305151.125836:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305151.126483:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.126572:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358720 00000100:00100000:1.0:1788305151.126580:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358720 00000100:00100000:1.0:1788305151.126614:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305151.126622:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358720:12345-0@lo:502: 00000100:00100000:1.0:1788305151.126863:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358720:12345-0@lo:502: Request processed in 240us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.126871:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305151.127002:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358720:0@lo:502: 00000040:00080000:3.0:1788305151.127247:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788305151.127261:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788305151.127940:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788305151.127948:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788305151.127953:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305151.127956:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788305151.127962:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305151.127985:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96fa818c19b8) 00000020:00000080:0.0:1788305151.128004:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788305151.128011:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788305151.128258:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbb95e7800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788305151.128265:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788305151.128273:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x902a3611c9ae82c7 00010000:00010000:1.0:1788305151.133330:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788305151.133738:0:6692:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788305151.136325:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788305151.136743:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788305151.144958:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788305151.145665:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788305151.146942:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788305151.146953:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305151.146959:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305151.146962:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788305151.146965:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305151.146970:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305151.146971:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305151.146974:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305151.146976:0:6692:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305151.147025:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305151.147028:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305151.147030:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788305151.147033:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788305151.147225:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788305151.147255:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788305151.147278:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147290:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305151.147297:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb95e7800 from 1 10000000:01000000:1.0:1788305151.147300:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305151.147334:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147343:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147353:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.147385:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358848:0@lo:101: 00000100:00100000:1.0:1788305151.147455:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.147500:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.147524:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358848 00000100:00100000:1.0:1788305151.147531:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358848 00000100:00100000:1.0:1788305151.147570:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305151.147579:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:6673:x1875173761358848:12345-0@lo:101: 00010000:00010000:1.0:1788305151.147591:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305151.147603:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae82ce expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147626:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147645:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147654:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fda00, rc 0) 00000100:00100000:1.0:1788305151.147693:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761358848:12345-0@lo:101: Request processed in 115us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.147700:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305151.147744:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358848:0@lo:101: 00010000:00010000:1.0:1788305151.147759:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.147767:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.147850:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358976:0@lo:501: 00000100:00100000:1.0:1788305151.147875:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.147898:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305151.148108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761358976 00000100:00100000:3.0:1788305151.148113:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761358976 00000100:00100000:3.0:1788305151.148153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305151.148162:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761358976:12345-0@lo:501: 00000100:00100000:3.0:1788305151.148459:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761358976:12345-0@lo:501: Request processed in 297us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.148466:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788305151.148551:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761358976:0@lo:501: 00000100:00100000:1.0:1788305151.148578:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359104:0@lo:503: 00000100:00100000:1.0:1788305151.148616:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.148644:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305151.148684:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359104 00000100:00100000:3.0:1788305151.148689:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359104 00000100:00100000:3.0:1788305151.148715:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305151.148722:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359104:12345-0@lo:503: 00000100:00100000:3.0:1788305151.148873:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359104:12345-0@lo:503: Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.148880:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788305151.148955:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359104:0@lo:503: 00000040:00080000:1.0:1788305151.149251:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305151.149315:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359232:0@lo:502: 00000100:00100000:1.0:1788305151.149348:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.149579:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e7cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305151.155401:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359232 00000100:00100000:3.0:1788305151.155417:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359232 00000100:00100000:3.0:1788305151.155481:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305151.155493:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359232:12345-0@lo:502: 00000100:00100000:3.0:1788305151.155746:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359232:12345-0@lo:502: Request processed in 255us (6396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.155754:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788305151.157518:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359232:0@lo:502: 00000040:00080000:1.0:1788305151.157852:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788305151.157906:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788305151.157943:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359360:0@lo:502: 00000100:00100000:1.0:1788305151.158003:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.158049:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305151.158165:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359360 00000100:00100000:3.0:1788305151.158172:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359360 00000100:00100000:3.0:1788305151.158213:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305151.158222:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359360:12345-0@lo:502: 00000100:00100000:3.0:1788305151.158455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359360:12345-0@lo:502: Request processed in 233us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.158471:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788305151.158617:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359360:0@lo:502: 00000040:00080000:1.0:1788305151.158702:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788305151.158712:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788305151.159582:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305151.159592:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305151.159595:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788305151.159602:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbb95e7800 00000020:00000080:3.0:1788305151.159604:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305151.159626:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305151.159629:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305151.159630:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788305151.159633:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788305151.159761:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788305151.159781:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305151.160218:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.160231:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305151.160273:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788305151.160276:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96fbb95e7800 10000000:01000000:1.0:1788305151.160279:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96fbb95e7800 10000000:01000000:1.0:1788305151.160283:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305151.160288:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fbb95e7800 from 1 10000000:01000000:1.0:1788305151.160291:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305151.160322:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.160330:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.160353:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.160383:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359488:0@lo:101: 00000100:00100000:1.0:1788305151.160433:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.160470:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305151.160582:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359488 00000100:00100000:0.0:1788305151.160589:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359488 00000100:00100000:0.0:1788305151.160634:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788305151.160643:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761359488:12345-0@lo:101: 00010000:00010000:0.0:1788305151.160654:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305151.160666:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae82dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.160687:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.160697:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305151.160706:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031600, rc 0) 00000100:00100000:0.0:1788305151.160740:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359488:12345-0@lo:101: Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.160747:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305151.162173:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359488:0@lo:101: 00010000:00010000:1.0:1788305151.162194:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.162204:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.162306:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359616:0@lo:501: 00000100:00100000:1.0:1788305151.162348:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.162391:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88142180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.162408:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359616 00000100:00100000:1.0:1788305151.162413:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359616 00000100:00100000:1.0:1788305151.162450:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788305151.162459:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359616:12345-0@lo:501: 00000100:00100000:1.0:1788305151.162677:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359616:12345-0@lo:501: Request processed in 218us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.162684:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788305151.162718:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359616:0@lo:501: 00000100:00100000:1.0:1788305151.162741:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359744:0@lo:503: 00000100:00100000:1.0:1788305151.162781:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.162794:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb9303a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.162807:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359744 00000100:00100000:1.0:1788305151.162811:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359744 00000100:00100000:1.0:1788305151.162832:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788305151.162839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359744:12345-0@lo:503: 00000100:00100000:1.0:1788305151.162972:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359744:12345-0@lo:503: Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.162980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788305151.163018:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359744:0@lo:503: 00000040:00080000:1.0:1788305151.163324:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305151.163377:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359872:0@lo:502: 00000100:00100000:1.0:1788305151.163410:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.163425:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb9303a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305151.163438:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761359872 00000100:00100000:1.0:1788305151.163442:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761359872 00000100:00100000:1.0:1788305151.163461:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305151.163466:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359872:12345-0@lo:502: 00000100:00100000:1.0:1788305151.163607:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761359872:12345-0@lo:502: Request processed in 139us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.163614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305151.163652:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761359872:0@lo:502: 00000040:00080000:1.0:1788305151.163886:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788305151.163933:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788305151.163974:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788305151.164038:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788305151.164107:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788305151.164184:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788305151.164223:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788305151.164261:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788305151.164311:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788305151.164362:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788305151.164402:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788305151.164452:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788305151.164489:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788305151.164521:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788305151.164568:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788305151.164605:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788305151.164636:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788305151.164684:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788305151.164722:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788305151.164757:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788305151.164818:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788305151.164861:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788305151.164895:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788305151.164941:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788305151.164977:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788305151.165022:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788305151.165115:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788305151.167645:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788305151.167709:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761360000:0@lo:502: 00000100:00100000:1.0:1788305151.167799:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.167852:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb9303a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305151.167931:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360000 00000100:00100000:2.0:1788305151.167939:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360000 00000100:00100000:2.0:1788305151.167987:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788305151.167997:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761360000:12345-0@lo:502: 00000100:00100000:2.0:1788305151.168264:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761360000:12345-0@lo:502: Request processed in 268us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305151.168272:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305151.168508:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761360000:0@lo:502: 00000040:00080000:3.0:1788305151.168598:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788305151.168610:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788305151.169129:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788305151.169157:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96fb85028000) 00000020:00000080:3.0:1788305151.169177:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788305151.169245:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbb95e7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788305151.169250:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fbb95e7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788305151.169252:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fbb95e7800 3 00010000:00080000:3.0:1788305151.169295:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fa81b47000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788305151.174083:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788305151.177354:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788305151.177395:0:6697:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305151.177407:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x902a3611c9ae82f1 00000100:00080000:3.0:1788305151.177418:0:6697:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305151.177424:0:6697:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96fa81b47000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305151.177456:0:6697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbc16adc00 x1875173761360128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305151.177484:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788305151.177532:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875173761360128:0@lo:38: 00000100:00100000:0.0:1788305151.177601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305151.177664:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360128 00000100:00100000:0.0:1788305151.177671:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360128 00000040:00080000:3.0:1788305151.177684:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1788305151.177699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305151.177706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1875173761360128:12345-0@lo:38: 00010000:00080000:0.0:1788305151.177726:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1788305151.177764:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x902a3611c9ae82f8 00000004:00100000:0.0:1788305151.177778:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305151.177806:0:5834:0:(import.c:65:import_set_state_nolock()) ffff96fb90ef9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305151.177863:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875173761360128:12345-0@lo:38: Request processed in 156us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305151.177870:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1788305151.177981:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788305151.178005:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305151.178023:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.178047:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788305151.178103:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788305151.178106:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788305151.178107:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305151.178108:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305151.178109:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305151.178110:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305151.178112:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305151.178113:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305151.178115:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305151.178116:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305151.178117:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305151.178121:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788305151.178123:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305151.178125:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788305151.178126:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305151.178127:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305151.178128:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305151.178129:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305151.178130:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305151.178131:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305151.178131:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305151.178132:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305151.178133:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305151.178157:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788305151.178168:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761360384:0@lo:253: 00000100:00100000:2.0:1788305151.178203:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305151.178217:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb985d30c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788305151.178358:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96fbc16adc00 x1875173761360128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305151.178369:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305151.178376:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788305151.178382:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788305151.178385:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788305151.178387:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fa81b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788305151.178392:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875173761360128:0@lo:38: 00000100:00100000:0.0:1788305151.179267:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761360256:0@lo:400: 00000100:00100000:0.0:1788305151.179311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305151.179369:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360384 00000100:00100000:0.0:1788305151.179375:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360384 00000100:00100000:0.0:1788305151.179412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305151.179421:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6673:x1875173761360384:12345-0@lo:253: 20000000:01000000:0.0:1788305151.179446:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788305151.179459:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788305151.179705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360256 00000100:00100000:3.0:1788305151.179709:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360256 00000100:00100000:3.0:1788305151.179743:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305151.179750:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761360256:12345-0@lo:400: 00000100:00100000:3.0:1788305151.179799:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761360256:12345-0@lo:400: Request processed in 49us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.179805:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788305151.179808:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96fba059a680 x1875173761360256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305151.179820:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761360256:0@lo:400: 20000000:01000000:0.0:1788305151.207805:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788305151.207861:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788305151.209708:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788305151.209718:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788305151.209741:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.209761:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.209784:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.209827:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.209842:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 13 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.209857:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875173761360512:0@lo:104: 00000100:00100000:1.0:1788305151.209922:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.210013:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90e6f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305151.210339:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360512 00000100:00100000:3.0:1788305151.210347:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360512 00000100:00100000:3.0:1788305151.210489:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305151.210500:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5848:x1875173761360512:12345-0@lo:104: 00010000:00010000:3.0:1788305151.210514:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305151.210586:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305151.210593:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5848:x1875173761360512:12345-0@lo:104: Request processed in 95us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.210601:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305151.210675:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875173761360512:0@lo:104: 00010000:00010000:1.0:1788305151.210694:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.210753:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305151.210760:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.210779:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7da00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305151.210783:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.210791:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305151.210799:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305151.210804:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305151.210843:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.210849:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305151.210866:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.210872:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7da00/0x902a3611c9ae8257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae825e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.210887:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305151.210889:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305151.210891:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305151.210971:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761360640:0@lo:103: 00000100:00100000:0.0:1788305151.211016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305151.211328:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360640 00000100:00100000:1.0:1788305151.211334:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360640 00010000:00010000:1.0:1788305151.211354:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 14 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.211394:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305151.211402:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83071450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:3302:x1875173761360640:12345-0@lo:103: 00010000:00010000:1.0:1788305151.211414:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305151.211420:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 14 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211430:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 14 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211451:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81491a00/0x902a3611c9ae825e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8257 expref: 14 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211466:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211473:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305151.211485:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001768019s 00010000:00010000:1.0:1788305151.211490:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211497:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211504:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211510:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211515:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305151.211519:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211526:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211540:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305151.211561:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305151.211753:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.211761:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305151.211778:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae82ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305151.215710:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83071450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3302:x1875173761360640:12345-0@lo:103: Request processed in 4299us (4682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305151.215725:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305151.215952:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761360640:0@lo:103: 00000100:00100000:3.0:1788305151.221081:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:6673:x1875173761360384:12345-0@lo:253: Request processed in 41651us (42867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305151.221096:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305151.221207:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:6673:1875173761360384:0@lo:253: 10000000:01000000:0.0:1788305151.221224:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788305151.221228:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305151.221229:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305151.221231:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305151.221232:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305151.221233:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305151.221234:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305151.221236:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305151.221238:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305151.221239:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305151.221241:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305151.221243:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788305151.221258:0:6673:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788305151.225796:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305151.226000:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305151.226331:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305151.226584:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788305151.226803:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788305151.227040:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788305151.228570:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788305151.440577:0:6673:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788305151.440585:0:6673:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788305151.440617:0:6673:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788305151.440677:0:6673:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788305151.440692:0:6673:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788305151.440721:0:6673:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788305151.857340:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305152.882161:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305153.910556:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305154.929410:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788305155.832105:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788305155.832113:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fb8951b000 from 21 10000000:01000000:3.0:1788305155.832118:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305155.832159:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305155.832169:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305155.832181:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305155.832204:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761360768:0@lo:101: 00000100:00100000:3.0:1788305155.832270:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.832321:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d15480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305155.832544:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360768 00000100:00100000:2.0:1788305155.832552:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360768 00000100:00100000:2.0:1788305155.832603:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788305155.832613:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761360768:12345-0@lo:101: 00010000:00010000:2.0:1788305155.832627:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305155.832640:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8306 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.832663:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.832673:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.832681:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7de00, rc 0) 00000100:00100000:2.0:1788305155.832729:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761360768:12345-0@lo:101: Request processed in 117us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305155.832736:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305155.839361:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761360768:0@lo:101: 00010000:00010000:0.0:1788305155.839388:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305155.839401:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305155.839485:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761360896:0@lo:501: 00000100:00100000:0.0:1788305155.839540:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305155.839578:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa81c819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305155.841437:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761360896 00000100:00100000:3.0:1788305155.841450:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761360896 00000100:00100000:3.0:1788305155.841502:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305155.841512:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761360896:12345-0@lo:501: 00000100:00100000:3.0:1788305155.841905:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761360896:12345-0@lo:501: Request processed in 393us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305155.842458:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788305155.845375:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761360896:0@lo:501: 00000100:00100000:2.0:1788305155.845453:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361024:0@lo:503: 00000100:00100000:3.0:1788305155.845663:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.845738:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305155.848873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361024 00000100:00100000:1.0:1788305155.848890:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361024 00000100:00100000:1.0:1788305155.849135:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305155.849147:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761361024:12345-0@lo:503: 00000100:00100000:1.0:1788305155.849787:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761361024:12345-0@lo:503: Request processed in 640us (4121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305155.849797:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305155.850200:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361024:0@lo:503: 00000100:00100000:3.0:1788305155.850602:0:6916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6916:1875173761361152:0@lo:502: 00000100:00100000:3.0:1788305155.850651:0:6916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.850695:0:6916:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d15180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305155.850745:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361152 00000100:00100000:1.0:1788305155.850752:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361152 00000100:00100000:1.0:1788305155.850782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305155.850790:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6916:x1875173761361152:12345-0@lo:502: 00000100:00100000:1.0:1788305155.851233:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6916:x1875173761361152:12345-0@lo:502: Request processed in 442us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305155.851245:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305155.851484:0:6916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6916:1875173761361152:0@lo:502: 00000100:00100000:1.0:1788305155.851533:0:6916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6916:1875173761361280:0@lo:502: 00000100:00100000:1.0:1788305155.851568:0:6916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305155.851598:0:6916:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305155.852333:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361280 00000100:00100000:0.0:1788305155.852341:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361280 00000100:00100000:0.0:1788305155.852382:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788305155.852390:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6916:x1875173761361280:12345-0@lo:502: 00000100:00100000:0.0:1788305155.852703:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:6916:x1875173761361280:12345-0@lo:502: Request processed in 313us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305155.852711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305155.853191:0:6916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6916:1875173761361280:0@lo:502: 00000040:00080000:1.0:1788305155.853221:0:6916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788305155.855418:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788305155.855463:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305155.855476:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305155.855489:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305155.855498:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305155.855500:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fb8951b000 from 4 10000000:01000000:0.0:1788305155.855503:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305155.855539:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305155.855546:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305155.855556:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305155.855585:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361408:0@lo:101: 00000100:00100000:0.0:1788305155.855645:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305155.855687:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa81c81300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305155.856263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361408 00000100:00100000:1.0:1788305155.856280:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361408 00000100:00100000:1.0:1788305155.856330:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305155.856339:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761361408:12345-0@lo:101: 00010000:00010000:1.0:1788305155.856354:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305155.856380:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8314 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.856406:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.856417:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.856426:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd200, rc 0) 00000100:00100000:1.0:1788305155.856479:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761361408:12345-0@lo:101: Request processed in 141us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305155.856486:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305155.856528:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361408:0@lo:101: 00010000:00010000:1.0:1788305155.856541:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.856558:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305155.856607:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361536:0@lo:256: 00000100:00100000:1.0:1788305155.856637:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305155.856659:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d0f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305155.856671:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361536 00000100:00100000:1.0:1788305155.856675:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361536 00000100:00100000:1.0:1788305155.856702:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305155.856708:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761361536:12345-0@lo:256: 20000000:01000000:1.0:1788305155.856720:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305155.856735:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305155.856739:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788305155.856808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761361536:12345-0@lo:256: Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305155.856814:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305155.856840:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361536:0@lo:256: 10000000:01000000:1.0:1788305155.856877:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305155.856883:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.856891:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305155.856899:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788305155.856901:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788305155.856904:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788305155.857577:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.857587:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.857594:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305155.857608:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361664:0@lo:101: 00000100:00100000:1.0:1788305155.857653:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305155.857678:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d0f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305155.857692:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361664 00000100:00100000:1.0:1788305155.857697:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361664 00000100:00100000:1.0:1788305155.857722:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305155.857729:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761361664:12345-0@lo:101: 00010000:00010000:1.0:1788305155.857739:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305155.857748:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.857764:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.857773:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.857780:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd800, rc 0) 00000100:00100000:1.0:1788305155.857884:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761361664:12345-0@lo:101: Request processed in 154us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305155.857889:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305155.858624:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361664:0@lo:101: 00010000:00010000:1.0:1788305155.858639:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305155.858648:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305155.858702:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361792:0@lo:501: 00000100:00100000:1.0:1788305155.858745:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305155.858780:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d0f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305155.858954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361792 00000100:00100000:0.0:1788305155.858960:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361792 00000100:00100000:0.0:1788305155.858996:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305155.859003:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761361792:12345-0@lo:501: 00000100:00100000:0.0:1788305155.859285:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761361792:12345-0@lo:501: Request processed in 282us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305155.859292:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305155.860507:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361792:0@lo:501: 00000100:00100000:1.0:1788305155.860567:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361920:0@lo:503: 00000100:00100000:1.0:1788305155.861313:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305155.861347:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305155.868613:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761361920 00000100:00100000:2.0:1788305155.868628:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761361920 00000100:00100000:2.0:1788305155.868679:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305155.868689:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761361920:12345-0@lo:503: 00000100:00100000:2.0:1788305155.869116:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761361920:12345-0@lo:503: Request processed in 427us (7803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305155.869124:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305155.869201:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761361920:0@lo:503: 00000100:00100000:2.0:1788305155.869420:0:6921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6921:1875173761362048:0@lo:502: 00000100:00100000:2.0:1788305155.869470:0:6921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305155.869497:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362048 00000100:00100000:2.0:1788305155.869502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362048 00000100:00100000:2.0:1788305155.869525:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305155.869533:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:6921:x1875173761362048:12345-0@lo:502: 00000100:00100000:2.0:1788305155.869729:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:6921:x1875173761362048:12345-0@lo:502: Request processed in 196us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305155.869737:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305155.869787:0:6921:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305155.869800:0:6921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6921:1875173761362048:0@lo:502: 00000020:01000000:2.0:1788305155.869822:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305155.869830:0:6921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788305155.869836:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305155.869838:0:6921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788305155.869842:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788305155.869846:0:6921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:2.0:1788305155.869866:0:6921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788305155.869874:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305155.869886:0:6921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96fba0524d28) 00000020:00000080:2.0:1788305155.869905:0:6921:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788305155.869911:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788305155.869985:0:6921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788305155.869991:0:6921:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788305155.869997:0:6921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae8337 00010000:00080000:2.0:1788305155.870023:0:6921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fbc1365000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1788305155.870271:0:6921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1788305155.957320:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788305155.961470:0:6921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788305155.961490:0:6921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788305155.961987:0:6921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305155.962195:0:6921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305155.962246:0:6921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788305155.962305:0:6921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788305155.966206:0:6927:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305155.966215:0:6927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788305155.983079:0:6921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305155.983181:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788305155.983222:0:6921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788305155.983244:0:6921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae833e 00000100:00080000:3.0:1788305155.983256:0:6921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305155.983261:0:6921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96fbc1365000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305155.983605:0:6921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbc16ad180 x1875173761362176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305155.983634:0:6921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788305155.983706:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305155.983710:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305155.983712:0:6921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788305155.983715:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305155.983718:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305155.983719:0:6921:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305155.983722:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305155.983724:0:6921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788305155.983750:0:6921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6921:1875173761362304:0@lo:502: 00000100:00100000:3.0:1788305155.983823:0:6921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.983868:0:6921:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87feba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305155.984597:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362304 00000100:00100000:2.0:1788305155.984605:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362304 00000100:00100000:2.0:1788305155.984650:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788305155.984660:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:6921:x1875173761362304:12345-0@lo:502: 00000100:00100000:2.0:1788305155.984890:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:6921:x1875173761362304:12345-0@lo:502: Request processed in 231us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305155.984897:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305155.985524:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761362432:0@lo:400: 00000100:00100000:3.0:1788305155.985563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.985599:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305155.985604:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761362560:0@lo:400: 00000100:00100000:3.0:1788305155.985624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.985652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362432 00000100:00100000:3.0:1788305155.985657:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362432 00000100:00100000:3.0:1788305155.985684:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362560 00000100:00100000:3.0:1788305155.985686:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362560 00000100:00100000:3.0:1788305155.985708:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305155.985715:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761362432:12345-0@lo:400: 00000100:00100000:3.0:1788305155.985753:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761362432:12345-0@lo:400: Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305155.985759:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305155.985770:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305155.985777:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761362560:12345-0@lo:400: 00000100:00100000:3.0:1788305155.985800:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761362560:12345-0@lo:400: Request processed in 24us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305155.985804:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788305155.985827:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788305155.985852:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fba0598e00 x1875173761362560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305155.985865:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761362560:0@lo:400: 00010000:00080000:3.0:1788305155.985876:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fba0599180 x1875173761362432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305155.985883:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761362432:0@lo:400: 00000100:00100000:2.0:1788305155.986606:0:6921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:6921:1875173761362304:0@lo:502: 00000020:01000000:2.0:1788305155.986642:0:6921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305155.986648:0:6921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305155.986650:0:6921:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788305155.986654:0:6921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788305155.987030:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788305155.987048:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788305155.987089:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305155.987108:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305155.987117:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788305155.987120:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96fba05219b8 from 1 10000000:01000000:3.0:1788305155.987123:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788305155.987153:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305155.987160:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305155.987167:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305155.987182:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761362688:0@lo:101: 00000100:00100000:3.0:1788305155.987224:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.987256:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87febc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305155.987534:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362688 00000100:00100000:2.0:1788305155.987548:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362688 00000100:00100000:2.0:1788305155.987589:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305155.987599:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761362688:12345-0@lo:101: 00010000:00010000:2.0:1788305155.987610:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305155.987622:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8345 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.987642:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305155.987642:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761362176:0@lo:8: 00010000:00010000:2.0:1788305155.987651:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.987660:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7cc00, rc 0) 00000100:00100000:0.0:1788305155.987678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305155.988020:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362176 00000100:00100000:3.0:1788305155.988025:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362176 00000100:00100000:3.0:1788305155.988047:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305155.988081:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875173761362176:12345-0@lo:8: 00010000:00080000:3.0:1788305155.988104:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1788305155.988132:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae8353 00000100:00100000:2.0:1788305155.988185:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761362688:12345-0@lo:101: Request processed in 587us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305155.988191:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305155.988233:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761362688:0@lo:101: 00010000:00010000:2.0:1788305155.988248:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.988258:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305155.988569:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761362816:0@lo:501: 00000100:00100000:2.0:1788305155.988604:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305155.988629:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305155.988643:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362816 00000100:00100000:2.0:1788305155.988646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362816 00000100:00100000:2.0:1788305155.988683:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305155.988690:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761362816:12345-0@lo:501: 00000100:00100000:2.0:1788305155.989578:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761362816:12345-0@lo:501: Request processed in 883us (968us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305155.989588:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305155.989638:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761362816:0@lo:501: 10000000:01000000:2.0:1788305155.989667:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788305155.989674:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305155.989683:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788305155.994776:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96fa81b41000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788305155.994789:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788305155.994792:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788305156.000250:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305156.001245:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788305156.001360:0:6675:0:(import.c:65:import_set_state_nolock()) ffff96fa81b45000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305156.002630:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875173761362176:12345-0@lo:8: Request processed in 14569us (14945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305156.002641:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788305156.002725:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16ad180 x1875173761362176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305156.002737:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305156.002745:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788305156.002752:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788305156.002757:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788305156.002761:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc1365000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788305156.002791:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788305156.002797:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761362176:0@lo:8: 00000004:00080000:1.0:1788305156.002870:0:6927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788305156.002997:0:6927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173712942977ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788305156.085989:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788305156.086168:0:6931:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788305156.086195:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363072:0@lo:7: 00000100:00100000:3.0:1788305156.086265:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305156.086309:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87feb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305156.086331:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761362944:0@lo:13: 00000100:00100000:3.0:1788305156.086357:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305156.086402:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761362944 00000100:00100000:3.0:1788305156.086409:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761362944 00000100:00100000:3.0:1788305156.086458:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305156.086468:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761362944:12345-0@lo:13: 00002000:00000024:3.0:1788305156.086499:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788305156.086544:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761362944:12345-0@lo:13: Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305156.086551:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788305156.086579:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305156.086592:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16ac000 x1875173761362944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305156.086609:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761362944:0@lo:13: 00000100:00100000:2.0:1788305156.086653:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363072 00000100:00100000:2.0:1788305156.086658:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363072 00000100:00100000:2.0:1788305156.086696:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305156.086704:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6931:x1875173761363072:12345-0@lo:7: 00002000:00080000:2.0:1788305156.110735:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788305156.110746:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788305156.110844:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6931:x1875173761363072:12345-0@lo:7: Request processed in 24138us (24575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305156.110855:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788305156.112382:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16af100 x1875173761363072/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305172 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305156.112401:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363072:0@lo:7: 00000004:00080000:0.0:1788305156.112422:0:6931:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788305156.112459:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363200:0@lo:5: 00000100:00100000:0.0:1788305156.112509:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305156.112563:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa81c81600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305156.112614:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363200 00000100:00100000:1.0:1788305156.112620:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363200 00000100:00100000:1.0:1788305156.112669:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305156.112679:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6931:x1875173761363200:12345-0@lo:5: 00002000:00080000:1.0:1788305156.112704:0:6675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788305156.112708:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788305156.112995:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6931:x1875173761363200:12345-0@lo:5: Request processed in 317us (485us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788305156.113002:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788305156.113598:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc0f05180 x1875173761363200/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305172 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305156.113612:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363200:0@lo:5: 00000004:00080000:1.0:1788305156.113622:0:6931:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788305156.113648:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363328:0@lo:700: 00000100:00100000:1.0:1788305156.113675:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305156.113693:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbb5d0fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305156.119170:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363328 00000100:00100000:3.0:1788305156.119185:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363328 00000100:00100000:3.0:1788305156.119248:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305156.119259:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6931:x1875173761363328:12345-0@lo:700: 00000100:00100000:3.0:1788305156.119319:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875173761363456:0@lo:700: 00000100:00100000:3.0:1788305156.119383:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305156.119414:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87feb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305156.120526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363456 00000100:00100000:3.0:1788305156.120535:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363456 00000100:00100000:3.0:1788305156.120566:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305156.120574:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875173761363456:12345-0@lo:700: 40000000:02000000:0.0:1788305156.196091:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788305156.201775:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875173761363456:12345-0@lo:700: Request processed in 81194us (82383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305156.201793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788305156.201869:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16ac000 x1875173761363456/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788305172 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305156.201886:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875173761363456:0@lo:700: 40000000:02000000:3.0:1788305156.201899:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1788305156.265942:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788305156.265962:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788305156.266536:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6931:x1875173761363328:12345-0@lo:700: Request processed in 147274us (152854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305156.266552:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788305156.266562:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbb5d4ad80 x1875173761363328/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788305172 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305156.266586:0:6931:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788305156.266602:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363328:0@lo:700: 00000004:02000040:1.0:1788305156.320299:0:6931:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788305156.326962:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363584:0@lo:5: 00000100:00100000:0.0:1788305156.327030:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305156.327177:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87febcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305156.327228:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363584 00000100:00100000:1.0:1788305156.327236:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363584 00000100:00100000:1.0:1788305156.327330:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305156.327341:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6931:x1875173761363584:12345-0@lo:5: 00002000:00080000:1.0:1788305156.332152:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788305156.332171:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788305156.343759:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6931:x1875173761363584:12345-0@lo:5: Request processed in 16412us (16720us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788305156.343786:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788305156.343983:0:6931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc0f05500 x1875173761363584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305172 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305156.343999:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6931:1875173761363584:0@lo:5: 00000004:00080000:2.0:1788305156.344012:0:6931:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788305156.983634:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305157.994193:0:7045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788305158.011432:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305159.026678:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305160.049771:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305161.082324:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305161.457766:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761363712:0@lo:13: 00000100:00100000:3.0:1788305161.457839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305161.458287:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363712 00000100:00100000:1.0:1788305161.458308:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363712 00000100:00100000:1.0:1788305161.458359:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305161.458367:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761363712:12345-0@lo:13: 00002000:00000024:1.0:1788305161.458397:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305161.458441:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761363712:12345-0@lo:13: Request processed in 74us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305161.458447:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788305161.458468:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305161.458606:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc0f06a00 x1875173761363712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305161.458624:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761363712:0@lo:13: 00000100:00100000:0.0:1788305161.463691:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761363840:0@lo:400: 00000100:00100000:0.0:1788305161.463763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305161.463809:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305161.463816:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761363968:0@lo:400: 00000100:00100000:0.0:1788305161.463843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305161.463886:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363840 00000100:00100000:0.0:1788305161.463893:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363840 00000100:00100000:0.0:1788305161.463934:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788305161.463945:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3303:x1875173761363840:12345-0@lo:400: 00000100:00100000:0.0:1788305161.464011:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3303:x1875173761363840:12345-0@lo:400: Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305161.464018:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788305161.464050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761363968 00000100:00100000:0.0:1788305161.464076:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761363968 00000100:00100000:0.0:1788305161.464103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305161.464110:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761363968:12345-0@lo:400: 00000100:00100000:0.0:1788305161.464140:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761363968:12345-0@lo:400: Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305161.464145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788305161.464181:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc0f06a00 x1875173761363968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305161.464195:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761363968:0@lo:400: 00000100:00100000:0.0:1788305161.464205:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761363840:0@lo:400: 00000100:00100000:0.0:1788305161.464231:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761364096:0@lo:400: 00000100:00100000:0.0:1788305161.464253:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305161.464282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364096 00000100:00100000:0.0:1788305161.464286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364096 00000100:00100000:0.0:1788305161.464317:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305161.464324:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761364096:12345-0@lo:400: 00000100:00100000:0.0:1788305161.464357:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761364096:12345-0@lo:400: Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305161.464374:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788305161.464389:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305161.464407:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc0f05180 x1875173761364096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305161.464416:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761364096:0@lo:400: 00000001:00080000:3.0:1788305161.585105:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788305162.107413:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305163.133826:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305164.151303:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305165.169228:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305166.196346:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305166.580708:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761364608:0@lo:400: 00000100:00100000:1.0:1788305166.580789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305166.580853:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305166.580861:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761364224:0@lo:400: 00000100:00100000:1.0:1788305166.580902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305166.580929:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761364736:0@lo:13: 00000100:00100000:1.0:1788305166.580953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305166.581126:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761364352:0@lo:400: 00000100:00100000:0.0:1788305166.581156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305166.581177:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305166.581183:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761364480:0@lo:400: 00000100:00100000:0.0:1788305166.581202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305166.582144:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364608 00000100:00100000:3.0:1788305166.582155:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364608 00000100:00100000:3.0:1788305166.582214:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305166.582227:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761364608:12345-0@lo:400: 00000100:00100000:3.0:1788305166.582302:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761364608:12345-0@lo:400: Request processed in 79us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305166.582311:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305166.582605:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364224 00000100:00100000:1.0:1788305166.582610:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364224 00000100:00100000:1.0:1788305166.582658:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788305166.582666:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3301:x1875173761364224:12345-0@lo:400: 00000100:00100000:1.0:1788305166.582701:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3301:x1875173761364224:12345-0@lo:400: Request processed in 36us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305166.582708:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788305166.582736:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364736 00000100:00100000:1.0:1788305166.582740:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364736 00000100:00100000:1.0:1788305166.582764:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305166.582770:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761364736:12345-0@lo:13: 00002000:00000024:1.0:1788305166.582798:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305166.582829:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761364736:12345-0@lo:13: Request processed in 59us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305166.582835:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305166.582866:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761364224:0@lo:400: 00010000:00080000:1.0:1788305166.582894:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbb5d4ad80 x1875173761364736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305166.582904:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788305166.582924:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761364736:0@lo:13: 00010000:00080000:1.0:1788305166.582935:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16ad180 x1875173761364608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305166.582944:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761364608:0@lo:400: 00000100:00100000:0.0:1788305166.583188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364352 00000100:00100000:0.0:1788305166.583193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364352 00000100:00100000:0.0:1788305166.583218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364480 00000100:00100000:0.0:1788305166.583226:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364480 00000100:00100000:0.0:1788305166.583242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305166.583248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761364352:12345-0@lo:400: 00000100:00100000:0.0:1788305166.583289:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761364352:12345-0@lo:400: Request processed in 41us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305166.583295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305166.583307:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305166.583313:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761364480:12345-0@lo:400: 00000100:00100000:0.0:1788305166.583337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761364480:12345-0@lo:400: Request processed in 24us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305166.583343:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788305166.583360:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305166.583364:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788305166.583944:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16af100 x1875173761364480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305166.583957:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761364480:0@lo:400: 00010000:00080000:0.0:1788305166.583978:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16aed80 x1875173761364352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305166.583987:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761364352:0@lo:400: 00010000:00010000:2.0:1788305167.217239:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305168.241278:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305169.268315:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305169.336499:0:7617:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788305169.336505:0:7617:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788305169.336879:0:7617:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96fa818a7800 00000020:01000004:1.0:1788305169.336900:0:7617:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788305169.338274:0:7617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788305169.338296:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96fb90f48000) 00000020:00000080:1.0:1788305169.338317:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788305169.364237:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788305169.364502:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788305169.407987:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788305169.413144:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788305169.413179:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788305169.413237:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788305169.413265:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788305169.413630:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788305169.413641:0:7617:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788305169.413651:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x902a3611c9ae8361 00000020:01000004:3.0:1788305169.413659:0:7617:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788305169.413681:0:7617:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788305169.413685:0:7617:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788305169.413691:0:7617:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788305169.413713:0:7617:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788305169.413717:0:7617:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788305169.443211:0:7617:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788305169.443253:0:7617:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788305169.443258:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788305169.443260:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305169.443261:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305169.443263:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305169.443264:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305169.443265:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305169.443266:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305169.443268:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305169.443269:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305169.443271:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305169.443272:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305169.443276:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788305169.443279:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305169.443280:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305169.443281:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305169.443282:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305169.443283:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305169.443284:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305169.443286:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305169.443287:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305169.443288:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305169.443289:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305169.443290:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305169.443316:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788305169.443335:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761364864:0@lo:253: 00000100:00100000:2.0:1788305169.443411:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.443612:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305169.445553:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364864 00000100:00100000:0.0:1788305169.445565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364864 00000100:00100000:0.0:1788305169.445672:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788305169.445683:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:7617:x1875173761364864:12345-0@lo:253: 20000000:01000000:0.0:1788305169.445733:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788305169.445737:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788305169.445742:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788305169.445744:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788305169.448034:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305169.449843:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788305169.449878:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788305169.449933:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788305169.449945:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788305169.449977:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788305169.450028:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788305169.450941:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788305169.450967:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:0.0:1788305169.450969:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:0.0:1788305169.451014:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788305169.451024:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788305169.451270:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788305169.451288:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:0.0:1788305169.451328:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788305169.451339:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788305169.451369:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788305169.451422:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788305169.455466:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788305169.455504:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:0.0:1788305169.455506:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:0.0:1788305169.455542:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788305169.455552:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788305169.455580:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788305169.455588:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:0.0:1788305169.455617:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788305169.455628:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788305169.455726:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788305169.455768:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788305169.455785:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788305169.455788:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788305169.455791:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788305169.455802:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788305169.455804:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788305169.455851:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788305169.455854:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788305169.458173:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788305169.458272:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788305169.458332:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788305169.458781:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788305169.458838:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788305169.458892:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788305169.458906:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788305169.458909:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788305169.459977:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788305169.460351:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788305169.460392:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788305169.461006:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788305169.461220:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788305169.461301:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788305169.461318:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788305169.461320:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788305169.461959:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788305169.468547:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788305169.468602:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788305169.468691:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788305169.468707:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788305169.468710:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788305169.469474:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788305169.469539:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788305169.469596:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788305169.470174:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788305169.470213:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788305169.470270:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788305169.470293:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788305169.470296:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788305169.470306:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788305169.470326:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470345:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470353:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470362:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470369:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470376:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470384:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470423:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470447:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 16 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.470462:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761364992:0@lo:104: 00000100:00100000:3.0:1788305169.470534:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305169.470588:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470596:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 16 pid: 5826 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.470604:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ace00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365120:0@lo:104: 00010000:00010000:3.0:1788305169.470627:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470635:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 16 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.470644:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365248:0@lo:104: 00010000:00010000:3.0:1788305169.470664:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470671:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 16 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.470678:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365376:0@lo:104: 00010000:00010000:3.0:1788305169.470710:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.470727:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 16 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.470736:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365504:0@lo:104: 00000100:00100000:3.0:1788305169.470756:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba04920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305169.470991:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788305169.471009:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.471032:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.471049:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.471076:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.471087:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761364992 00000100:00100000:0.0:1788305169.471099:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761364992 00000100:00100000:0.0:1788305169.471130:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365120 00000100:00100000:0.0:1788305169.471133:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365120 00000100:00100000:0.0:1788305169.471142:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365248 00000100:00100000:0.0:1788305169.471144:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365248 00000100:00100000:0.0:1788305169.471151:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365376 00000100:00100000:0.0:1788305169.471153:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365376 00000100:00100000:0.0:1788305169.471162:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365504 00000100:00100000:0.0:1788305169.471164:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365504 00000100:00100000:0.0:1788305169.471176:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305169.471183:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb830f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+7:5826:x1875173761364992:12345-0@lo:104: 00010000:00010000:0.0:1788305169.471195:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471251:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305169.471257:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb830f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+7:5826:x1875173761364992:12345-0@lo:104: Request processed in 73us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.471263:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305169.471298:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305169.471305:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+6:5826:x1875173761365120:12345-0@lo:104: 00010000:00010000:0.0:1788305169.471313:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471351:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788305169.471356:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+6:5826:x1875173761365120:12345-0@lo:104: Request processed in 52us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.471362:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305169.471374:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305169.471380:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+5:5826:x1875173761365248:12345-0@lo:104: 00010000:00010000:0.0:1788305169.471395:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471422:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788305169.471428:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+5:5826:x1875173761365248:12345-0@lo:104: Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.471433:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305169.471445:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305169.471450:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+4:5826:x1875173761365376:12345-0@lo:104: 00010000:00010000:0.0:1788305169.471457:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471479:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788305169.471483:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+4:5826:x1875173761365376:12345-0@lo:104: Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.471489:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305169.471499:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305169.471504:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5826:x1875173761365504:12345-0@lo:104: 00010000:00010000:0.0:1788305169.471510:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471533:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788305169.471538:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5826:x1875173761365504:12345-0@lo:104: Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.471543:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788305169.471559:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788305169.471565:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471577:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81491a00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305169.471581:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471588:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305169.471594:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305169.471599:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305169.471627:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471633:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305169.471649:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471656:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae834c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471674:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788305169.471678:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471684:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305169.471687:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471703:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305169.471709:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305169.471714:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305169.471726:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471732:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305169.471737:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471744:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8329 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471756:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788305169.471759:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471765:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490c00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305169.471768:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471774:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305169.471779:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305169.471790:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305169.471802:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471807:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305169.471821:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471839:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae8306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae830d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471850:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305169.471853:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.471859:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305169.471997:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472007:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305169.472013:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305169.472018:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305169.472033:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472120:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305169.472135:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472142:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae82dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472154:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305169.472157:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472163:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305169.472165:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472171:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305169.472176:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305169.472182:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305169.472196:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472201:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305169.472205:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472210:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81490000/0x902a3611c9ae82b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472222:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305169.472229:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305169.472231:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305169.472249:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761365632:0@lo:103: 00000100:00100000:0.0:1788305169.472299:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.472336:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761366144:0@lo:103: 00000100:00100000:0.0:1788305169.472357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.472380:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305169.472386:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761365760:0@lo:103: 00000100:00100000:0.0:1788305169.472415:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.472447:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761365888:0@lo:103: 00000100:00100000:0.0:1788305169.472467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.472479:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305169.472483:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761366016:0@lo:103: 00000100:00100000:0.0:1788305169.472501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.472526:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365632 00000100:00100000:0.0:1788305169.472532:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365632 00010000:00010000:0.0:1788305169.472551:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 17 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.472566:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366144 00000100:00100000:0.0:1788305169.472568:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366144 00010000:00010000:0.0:1788305169.472576:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 18 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.472585:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365760 00000100:00100000:0.0:1788305169.472587:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365760 00010000:00010000:0.0:1788305169.472596:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 19 pid: 5826 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.472605:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761365888 00000100:00100000:0.0:1788305169.472617:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761365888 00010000:00010000:0.0:1788305169.472630:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 20 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.472641:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366016 00000100:00100000:0.0:1788305169.472644:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366016 00010000:00010000:0.0:1788305169.472653:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 21 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.472664:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305169.472670:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+21:3303:x1875173761365632:12345-0@lo:103: 00010000:00010000:0.0:1788305169.472681:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305169.472686:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 21 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472697:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 21 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472713:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305169.472745:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+21:3303:x1875173761365632:12345-0@lo:103: Request processed in 75us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.472752:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305169.472767:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305169.472773:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+20:3303:x1875173761366144:12345-0@lo:103: 00010000:00010000:0.0:1788305169.472781:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305169.472785:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 20 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472793:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 20 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.472812:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305169.472849:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+20:3303:x1875173761366144:12345-0@lo:103: Request processed in 76us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.472855:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788305169.473142:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761365632:0@lo:103: 00000100:00100000:1.0:1788305169.473151:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761366144:0@lo:103: 00010000:00010000:3.0:1788305169.473298:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae834c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8345 expref: 19 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.473310:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761364992:0@lo:104: 00000100:00100000:3.0:1788305169.473320:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ace00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365120:0@lo:104: 00000100:00100000:3.0:1788305169.473328:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365248:0@lo:104: 00000100:00100000:3.0:1788305169.473335:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365376:0@lo:104: 00010000:00010000:3.0:1788305169.473342:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae82b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae82b2 expref: 18 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.473352:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875173761365504:0@lo:104: 00010000:00010000:3.0:1788305169.473375:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305169.475285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305169.475304:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:3303:x1875173761365760:12345-0@lo:103: 00010000:00010000:3.0:1788305169.475322:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305169.475330:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 17 pid: 5826 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475358:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 17 pid: 5826 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475375:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd800/0x902a3611c9ae8329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8322 expref: 17 pid: 5826 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475391:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305169.475462:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3303:x1875173761365760:12345-0@lo:103: Request processed in 167us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.475470:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305169.475492:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305169.475499:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:3301:x1875173761365888:12345-0@lo:103: 00010000:00010000:3.0:1788305169.475506:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305169.475511:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 15 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475519:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 15 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475529:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae830d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8306 expref: 15 pid: 5827 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475538:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305169.475566:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:3301:x1875173761365888:12345-0@lo:103: Request processed in 67us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.475572:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305169.475584:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305169.475590:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3301:x1875173761366016:12345-0@lo:103: 00010000:00010000:3.0:1788305169.475604:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305169.475608:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 13 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475616:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 13 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475626:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031600/0x902a3611c9ae82e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae82dc expref: 13 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475638:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475647:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475661:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475667:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475673:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475679:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475686:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490e00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305169.475690:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475709:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475724:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475733:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305169.475757:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3301:x1875173761366016:12345-0@lo:103: Request processed in 168us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.475763:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788305169.475784:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475792:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.475798:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8368 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788305169.475811:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788305169.475928:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761365760:0@lo:103: 00000100:00100000:1.0:1788305169.478307:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761366016:0@lo:103: 00000100:00100000:1.0:1788305169.478319:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761365888:0@lo:103: 00000100:00100000:1.0:1788305169.565961:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+11:7617:x1875173761364864:12345-0@lo:253: Request processed in 120271us (122540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.565977:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305169.566159:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761364864:0@lo:253: 10000000:01000000:2.0:1788305169.566190:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788305169.566194:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305169.566196:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305169.566197:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305169.566198:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788305169.566199:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305169.566200:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305169.566202:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305169.566204:0:7617:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788305169.566205:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305169.566207:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788305169.566227:0:7617:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96fa818a7800 from lustre-OST0001 10000000:01000000:2.0:1788305169.566267:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788305169.566270:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788305169.566279:0:7617:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96fba05219b8 local copy 10000000:01000000:2.0:1788305169.566283:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788305169.566321:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.566332:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.566340:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.566358:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366272:0@lo:101: 00000100:00100000:2.0:1788305169.566393:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.566442:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305169.566502:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366272 00000100:00100000:3.0:1788305169.566508:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366272 00000100:00100000:3.0:1788305169.566550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305169.566559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+11:7617:x1875173761366272:12345-0@lo:101: 00010000:00010000:3.0:1788305169.566572:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305169.566585:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae836f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.566606:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae836f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.566624:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae836f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.566634:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81490e00, rc 0) 00000100:00100000:3.0:1788305169.567143:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366272:12345-0@lo:101: Request processed in 484us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.567151:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305169.567285:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366272:0@lo:101: 00010000:00010000:2.0:1788305169.567300:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.567320:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.567418:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366400:0@lo:501: 00000100:00100000:2.0:1788305169.567446:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.567478:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e220c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.567532:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366400 00000100:00100000:1.0:1788305169.567538:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366400 00000100:00100000:1.0:1788305169.567640:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305169.567662:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366400:12345-0@lo:501: 00000100:00100000:1.0:1788305169.567881:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366400:12345-0@lo:501: Request processed in 232us (433us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305169.567888:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788305169.567959:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366400:0@lo:501: 10000000:01000000:2.0:1788305169.567971:0:7617:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788305169.567998:0:7617:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788305169.568003:0:7617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.568011:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.568017:0:7617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.568035:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788305169.568085:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96fa818a7800 10000000:01000000:2.0:1788305169.568089:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305169.568094:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788305169.568096:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305169.568101:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788305169.568103:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788305169.568121:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.568138:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.568146:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.568157:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366528:0@lo:101: 00000100:00100000:2.0:1788305169.568183:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305169.569500:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305169.569511:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.569521:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305169.569524:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.569532:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305169.569540:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305169.569546:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305169.569578:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.569584:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305169.569612:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.569618:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae836f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x902a3611c9ae8376 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.569635:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305169.569660:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305169.569662:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305169.569678:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761366656:0@lo:103: 00000100:00100000:0.0:1788305169.569729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.570408:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305169.570490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366528 00000100:00100000:3.0:1788305169.570498:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366528 00000100:00100000:3.0:1788305169.570540:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788305169.570550:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366528:12345-0@lo:101: 00010000:00010000:3.0:1788305169.570563:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305169.570579:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae837d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.570602:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae837d expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.570612:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae837d expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.570620:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81491400, rc 0) 00000100:00100000:2.0:1788305169.575264:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366656 00000100:00100000:2.0:1788305169.575280:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366656 00000100:00100000:2.0:1788305169.575358:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305169.575368:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:3304:x1875173761366656:12345-0@lo:103: 00010000:00010000:2.0:1788305169.575383:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305169.575403:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae836f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.575420:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305169.575500:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3304:x1875173761366656:12345-0@lo:103: Request processed in 134us (5770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.575507:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305169.575554:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761366656:0@lo:103: 00000100:00100000:3.0:1788305169.575897:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366528:12345-0@lo:101: Request processed in 5347us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.575906:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305169.576107:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366528:0@lo:101: 00010000:00010000:2.0:1788305169.576125:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.576263:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.576387:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366784:0@lo:501: 00000100:00100000:2.0:1788305169.576421:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.576457:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305169.576507:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366784 00000100:00100000:3.0:1788305169.576511:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366784 00000100:00100000:3.0:1788305169.576534:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305169.576547:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366784:12345-0@lo:501: 00000100:00100000:3.0:1788305169.576810:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366784:12345-0@lo:501: Request processed in 263us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.576818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305169.577019:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366784:0@lo:501: 00000100:00100000:2.0:1788305169.577080:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366912:0@lo:503: 00000100:00100000:2.0:1788305169.577115:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.577131:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.577239:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761366912 00000100:00100000:1.0:1788305169.577245:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761366912 00000100:00100000:1.0:1788305169.577268:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788305169.577275:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366912:12345-0@lo:503: 00000100:00100000:1.0:1788305169.577430:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761366912:12345-0@lo:503: Request processed in 155us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.577437:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788305169.577570:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761366912:0@lo:503: 00000040:00080000:2.0:1788305169.577843:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305169.577907:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367040:0@lo:502: 00000100:00100000:2.0:1788305169.577942:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.577967:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.578270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367040 00000100:00100000:1.0:1788305169.578276:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367040 00000100:00100000:1.0:1788305169.578308:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305169.578315:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761367040:12345-0@lo:502: 00000100:00100000:1.0:1788305169.578452:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761367040:12345-0@lo:502: Request processed in 137us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.578459:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788305169.578859:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367040:0@lo:502: 00000040:00080000:2.0:1788305169.579111:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788305169.579152:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788305169.579181:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788305169.579228:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788305169.579265:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788305169.579299:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788305169.579331:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367168:0@lo:502: 00000100:00100000:2.0:1788305169.579642:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.579678:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.579920:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367168 00000100:00100000:1.0:1788305169.579926:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367168 00000100:00100000:1.0:1788305169.580144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788305169.580151:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761367168:12345-0@lo:502: 00000100:00100000:1.0:1788305169.580315:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761367168:12345-0@lo:502: Request processed in 164us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.580321:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788305169.580496:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367168:0@lo:502: 00000040:00080000:2.0:1788305169.580578:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788305169.580595:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788305169.581222:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305169.581231:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788305169.581238:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305169.581240:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788305169.581244:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305169.581268:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96fbaf4ecd28) 00000020:00000080:2.0:1788305169.581290:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788305169.581304:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305169.581362:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fa818a7800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788305169.581369:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305169.581386:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x902a3611c9ae8392 00010000:00010000:3.0:1788305169.587851:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788305169.588187:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788305169.589665:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788305169.589923:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788305169.593854:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788305169.597791:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788305169.600850:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788305169.600864:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305169.600870:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305169.600872:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788305169.600876:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305169.600880:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305169.600881:0:7624:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788305169.600884:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788305169.600885:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788305169.600940:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305169.600943:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305169.600944:0:7624:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788305169.600947:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788305169.606358:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788305169.606396:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788305169.606418:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.606431:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305169.606517:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fa818a7800 from 1 10000000:01000000:2.0:1788305169.606521:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305169.606563:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.606572:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.606602:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.606627:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367296:0@lo:101: 00000100:00100000:2.0:1788305169.606810:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.606868:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305169.607088:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367296 00000100:00100000:0.0:1788305169.607097:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367296 00000100:00100000:0.0:1788305169.607144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305169.607153:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:7617:x1875173761367296:12345-0@lo:101: 00010000:00010000:0.0:1788305169.607167:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305169.607180:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8399 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.607204:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.607215:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.607225:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030200, rc 0) 00000100:00100000:0.0:1788305169.607270:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367296:12345-0@lo:101: Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.607286:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305169.607485:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367296:0@lo:101: 00010000:00010000:1.0:1788305169.607501:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305169.607509:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305169.607613:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367424:0@lo:501: 00000100:00100000:1.0:1788305169.607640:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305169.607854:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305169.608247:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367424 00000100:00100000:2.0:1788305169.608253:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367424 00000100:00100000:2.0:1788305169.608283:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305169.608290:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367424:12345-0@lo:501: 00000100:00100000:2.0:1788305169.608510:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367424:12345-0@lo:501: Request processed in 219us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.608522:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788305169.608601:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367424:0@lo:501: 00000100:00100000:1.0:1788305169.608632:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367552:0@lo:503: 00000100:00100000:1.0:1788305169.608684:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305169.608707:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305169.608909:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367552 00000100:00100000:2.0:1788305169.608914:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367552 00000100:00100000:2.0:1788305169.608944:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305169.608952:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367552:12345-0@lo:503: 00000100:00100000:2.0:1788305169.609292:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367552:12345-0@lo:503: Request processed in 340us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.609298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788305169.609416:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367552:0@lo:503: 00000040:00080000:1.0:1788305169.609690:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305169.609755:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367680:0@lo:502: 00000100:00100000:1.0:1788305169.609796:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305169.609856:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305169.609957:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367680 00000100:00100000:0.0:1788305169.609964:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367680 00000100:00100000:0.0:1788305169.610000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305169.610007:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367680:12345-0@lo:502: 00000100:00100000:0.0:1788305169.610197:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367680:12345-0@lo:502: Request processed in 189us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.610204:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305169.610415:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367680:0@lo:502: 00000040:00080000:1.0:1788305169.610705:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788305169.610756:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788305169.610782:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367808:0@lo:502: 00000100:00100000:1.0:1788305169.610818:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305169.610855:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305169.610909:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367808 00000100:00100000:0.0:1788305169.610915:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367808 00000100:00100000:0.0:1788305169.610946:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305169.610953:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367808:12345-0@lo:502: 00000100:00100000:0.0:1788305169.611123:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367808:12345-0@lo:502: Request processed in 170us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.611130:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788305169.611275:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367808:0@lo:502: 00000040:00080000:2.0:1788305169.611361:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788305169.611373:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788305169.612033:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305169.612179:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305169.612182:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788305169.612190:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fa818a7800 00000020:00000080:1.0:1788305169.612193:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305169.612217:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305169.612220:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305169.612227:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788305169.612230:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788305169.613645:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788305169.613676:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305169.613731:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.613753:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305169.613804:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788305169.613807:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96fa818a7800 10000000:01000000:2.0:1788305169.613809:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96fa818a7800 10000000:01000000:2.0:1788305169.613813:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305169.613819:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fa818a7800 from 1 10000000:01000000:2.0:1788305169.613822:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305169.613866:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.613874:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.613885:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.613906:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367936:0@lo:101: 00000100:00100000:2.0:1788305169.613963:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.614005:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.614177:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761367936 00000100:00100000:1.0:1788305169.614185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761367936 00000100:00100000:1.0:1788305169.614228:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788305169.614237:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761367936:12345-0@lo:101: 00010000:00010000:1.0:1788305169.614250:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305169.614263:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae83a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305169.614288:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305169.614299:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305169.614309:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e200, rc 0) 00000100:00100000:1.0:1788305169.614348:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761367936:12345-0@lo:101: Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.614355:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788305169.616465:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761367936:0@lo:101: 00010000:00010000:2.0:1788305169.616491:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.616503:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.616637:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368064:0@lo:501: 00000100:00100000:2.0:1788305169.616690:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.616720:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.616771:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368064 00000100:00100000:1.0:1788305169.616778:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368064 00000100:00100000:1.0:1788305169.616821:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788305169.616839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368064:12345-0@lo:501: 00000100:00100000:1.0:1788305169.617100:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368064:12345-0@lo:501: Request processed in 262us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.617107:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305169.617193:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368064:0@lo:501: 00000100:00100000:2.0:1788305169.617220:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368192:0@lo:503: 00000100:00100000:2.0:1788305169.617256:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.617455:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368192 00000100:00100000:2.0:1788305169.617460:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368192 00000100:00100000:2.0:1788305169.617490:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305169.617497:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368192:12345-0@lo:503: 00000100:00100000:2.0:1788305169.617626:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368192:12345-0@lo:503: Request processed in 128us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.617633:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305169.617662:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305169.617674:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368192:0@lo:503: 00000040:00080000:2.0:1788305169.617921:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305169.617972:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368320:0@lo:502: 00000100:00100000:2.0:1788305169.618007:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.618029:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368320 00000100:00100000:2.0:1788305169.618034:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368320 00000100:00100000:2.0:1788305169.618079:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788305169.618086:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368320:12345-0@lo:502: 00000100:00100000:2.0:1788305169.618218:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368320:12345-0@lo:502: Request processed in 133us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.618232:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788305169.618259:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305169.618270:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368320:0@lo:502: 00000040:00080000:2.0:1788305169.618498:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788305169.618539:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788305169.618568:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788305169.618614:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788305169.618651:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788305169.618697:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788305169.618735:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788305169.618769:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788305169.618815:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788305169.618876:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788305169.618911:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788305169.618958:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788305169.618992:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788305169.619026:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788305169.619110:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788305169.619151:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788305169.619186:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788305169.619232:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788305169.619271:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788305169.619323:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788305169.619380:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788305169.619416:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788305169.619446:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788305169.619489:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788305169.619522:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788305169.619571:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788305169.619639:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788305169.619678:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788305169.619723:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788305169.619773:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788305169.619810:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788305169.619859:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788305169.619894:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788305169.619942:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788305169.619979:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788305169.620025:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788305169.620085:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788305169.620127:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368448:0@lo:502: 00000100:00100000:2.0:1788305169.620189:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.620233:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368448 00000100:00100000:2.0:1788305169.620239:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368448 00000100:00100000:2.0:1788305169.620273:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305169.620281:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368448:12345-0@lo:502: 00000100:00100000:3.0:1788305169.621236:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e22840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305169.621485:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761368448:12345-0@lo:502: Request processed in 1203us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.621494:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788305169.621591:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761368448:0@lo:502: 00000040:00080000:3.0:1788305169.621698:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788305169.621712:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788305169.622637:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788305169.622654:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96fb8502b370) 00000020:00000080:3.0:1788305169.622674:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788305169.622760:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fa818a7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788305169.622764:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fa818a7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788305169.622767:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fa818a7800 3 00010000:00080000:3.0:1788305169.622794:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fbc1465000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788305169.624450:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788305169.624662:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788305169.624694:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305169.624714:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x902a3611c9ae83bc 00000100:00080000:3.0:1788305169.624726:0:7629:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305169.624731:0:7629:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96fbc1465000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305169.624765:0:7629:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbc16ac700 x1875173761368576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305169.624799:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788305169.625102:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875173761368576:0@lo:38: 00000100:00100000:0.0:1788305169.625174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.625382:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761368960:0@lo:400: 00000100:00100000:2.0:1788305169.625413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.625452:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368960 00000100:00100000:2.0:1788305169.625457:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368960 00000100:00100000:2.0:1788305169.625505:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305169.625515:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761368960:12345-0@lo:400: 00000100:00100000:2.0:1788305169.625563:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761368960:12345-0@lo:400: Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.625571:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788305169.625590:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305169.625603:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761368832:0@lo:400: 00000100:00100000:2.0:1788305169.625637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.625657:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305169.625663:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761368704:0@lo:400: 00000100:00100000:2.0:1788305169.625684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.625708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368576 00000100:00100000:2.0:1788305169.625711:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368576 00000100:00100000:2.0:1788305169.625725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368832 00000100:00100000:2.0:1788305169.625727:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368832 00000100:00100000:2.0:1788305169.625748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761368704 00000100:00100000:2.0:1788305169.625751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761368704 00000100:00100000:2.0:1788305169.625762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305169.625769:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761368832:12345-0@lo:400: 00000100:00100000:2.0:1788305169.625802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761368832:12345-0@lo:400: Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.625809:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305169.625820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305169.625860:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761368704:12345-0@lo:400: 00000100:00100000:2.0:1788305169.625888:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761368704:12345-0@lo:400: Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.625894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305169.625906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305169.625909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1875173761368576:12345-0@lo:38: 00010000:00080000:2.0:1788305169.625927:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1788305169.625967:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x902a3611c9ae83c3 00000004:00100000:2.0:1788305169.625980:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788305169.626009:0:5833:0:(import.c:65:import_set_state_nolock()) ffff96fbaf4f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305169.626080:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875173761368576:12345-0@lo:38: Request processed in 169us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305169.626090:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788305169.626166:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788305169.626185:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fba0599c00 x1875173761368960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305169.626194:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761368960:0@lo:400: 00010000:00080000:2.0:1788305169.626210:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fba059bb80 x1875173761368704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305169.626215:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761368704:0@lo:400: 00010000:00080000:2.0:1788305169.626220:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fba0599f80 x1875173761368832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305169.626224:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761368832:0@lo:400: 00010000:00080000:2.0:1788305169.626239:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbc16ac700 x1875173761368576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305169.626244:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305169.626248:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788305169.626254:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788305169.626257:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788305169.626258:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc1465000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788305169.626261:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875173761368576:0@lo:38: 00000040:00080000:0.0:1788305169.628249:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788305169.628480:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:1.0:1788305169.628615:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875173761369088:0@lo:901: 10000000:01000000:2.0:1788305169.628848:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305169.628903:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.628927:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788305169.628968:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788305169.628970:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305169.628971:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305169.628972:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305169.628974:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305169.628975:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305169.628976:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305169.628978:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305169.628979:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305169.628980:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305169.628982:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305169.628986:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788305169.628988:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305169.628989:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305169.628990:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305169.628991:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305169.628992:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305169.628993:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305169.628995:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305169.628995:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305169.628996:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305169.628997:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305169.628998:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305169.629012:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788305169.629020:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761369216:0@lo:253: 00000100:00100000:1.0:1788305169.629359:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.629365:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.629397:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305169.629401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369088 00000100:00100000:1.0:1788305169.629407:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369088 00000100:00100000:2.0:1788305169.629413:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369216 00000100:00100000:2.0:1788305169.629415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369216 00000100:00100000:2.0:1788305169.629445:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788305169.629445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305169.629453:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7617:x1875173761369216:12345-0@lo:253: 00000100:00100000:1.0:1788305169.629453:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875173761369088:12345-0@lo:901: 20000000:01000000:2.0:1788305169.629478:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788305169.629490:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788305169.630249:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875173761369088:12345-0@lo:901: Request processed in 794us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305169.630257:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305169.630282:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a900 going to sleep for 11 seconds 00010000:00080000:1.0:1788305169.630301:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbb5d4b480 x1875173761369088/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788305185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305169.630314:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875173761369088:0@lo:901: 00000100:00080000:1.0:1788305169.631126:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1788305169.666082:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788305169.666096:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788305169.666113:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305169.666117:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305169.666138:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.666157:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.666166:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.666210:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305169.666224:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 14 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305169.666238:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875173761369344:0@lo:104: 00000100:00100000:2.0:1788305169.666303:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305169.666389:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305169.666449:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369344 00000100:00100000:0.0:1788305169.666457:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369344 00000100:00100000:0.0:1788305169.666508:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305169.666517:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5848:x1875173761369344:12345-0@lo:104: 00010000:00010000:0.0:1788305169.666528:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.666617:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305169.666623:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:5848:x1875173761369344:12345-0@lo:104: Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.666644:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305169.667008:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875173761369344:0@lo:104: 00010000:00010000:2.0:1788305169.667033:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.667778:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305169.667787:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.667795:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305169.667800:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.667808:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305169.667815:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305169.667820:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305169.667878:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.667885:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305169.667919:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305169.667927:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae8314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae831b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.667946:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788305169.667951:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305169.667952:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305169.667954:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305169.667964:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761369472:0@lo:103: 00000100:00100000:0.0:1788305169.668014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305169.668079:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369472 00000100:00100000:0.0:1788305169.668085:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369472 00010000:00010000:0.0:1788305169.668107:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 15 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305169.668132:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305169.668140:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83070450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:3303:x1875173761369472:12345-0@lo:103: 00010000:00010000:0.0:1788305169.668154:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305169.668159:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 15 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668168:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 15 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668181:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae831b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8314 expref: 15 pid: 5828 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668194:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668202:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305169.668215:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002098044s 00010000:00010000:0.0:1788305169.668219:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668231:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668238:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668244:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668249:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7cc00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305169.668253:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668260:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668274:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668284:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305169.668327:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83070450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:3303:x1875173761369472:12345-0@lo:103: Request processed in 187us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305169.668334:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788305169.668383:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668391:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305169.668398:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7cc00/0x902a3611c9ae83ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305169.669091:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761369472:0@lo:103: 00000100:00100000:3.0:1788305169.676780:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:7617:x1875173761369216:12345-0@lo:253: Request processed in 47317us (47403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305169.676796:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788305169.676906:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:16674bd8-0f21-440d-92a6-ff3988850e9b:7617:1875173761369216:0@lo:253: 10000000:01000000:2.0:1788305169.676921:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788305169.676925:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305169.676926:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305169.676940:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305169.676941:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305169.676942:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305169.676943:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305169.676945:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305169.676946:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305169.676948:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305169.676949:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305169.676951:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788305169.676966:0:7617:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788305169.682342:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305169.682526:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788305169.682768:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305169.682947:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788305169.683167:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305169.683372:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788305169.685364:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788305169.932176:0:7617:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788305169.932183:0:7617:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788305169.932303:0:7617:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788305169.932362:0:7617:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788305169.932377:0:7617:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788305169.932404:0:7617:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788305170.289296:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305171.315335:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305171.697289:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305171.701559:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761369600:0@lo:13: 00000100:00100000:3.0:1788305171.701653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305171.701730:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369600 00000100:00100000:3.0:1788305171.701737:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369600 00000100:00100000:3.0:1788305171.701812:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305171.701823:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761369600:12345-0@lo:13: 00002000:00000024:3.0:1788305171.701859:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305171.701906:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761369600:12345-0@lo:13: Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305171.701913:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788305171.701956:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4b480 x1875173761369600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305171.701975:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761369600:0@lo:13: 00000100:00080000:2.0:1788305171.702499:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788305172.337289:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305173.368727:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305174.390490:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305174.769340:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761369856:0@lo:400: 00000100:00100000:1.0:1788305174.769402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305174.769455:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305174.769460:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761369984:0@lo:400: 00000100:00100000:1.0:1788305174.769483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305174.769520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369856 00000100:00100000:1.0:1788305174.769528:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369856 00000100:00100000:1.0:1788305174.769578:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369984 00000100:00100000:1.0:1788305174.769581:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369984 00000100:00100000:1.0:1788305174.769612:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305174.769620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761369856:12345-0@lo:400: 00000100:00100000:1.0:1788305174.769663:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761369856:12345-0@lo:400: Request processed in 42us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305174.769669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305174.769690:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305174.769696:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761369984:12345-0@lo:400: 00000100:00100000:1.0:1788305174.769719:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761369984:12345-0@lo:400: Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305174.769724:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788305174.769755:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788305174.769790:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4ad80 x1875173761369984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305174.769805:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761369984:0@lo:400: 00010000:00080000:1.0:1788305174.769814:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4b480 x1875173761369856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305174.769822:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761369856:0@lo:400: 00000100:00100000:2.0:1788305174.769873:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761369728:0@lo:400: 00000100:00100000:2.0:1788305174.769906:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305174.769936:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761370240:0@lo:400: 00000100:00100000:2.0:1788305174.769955:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305174.769968:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305174.769972:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761370112:0@lo:400: 00000100:00100000:2.0:1788305174.769990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305174.770224:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761369728 00000100:00100000:1.0:1788305174.770229:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761369728 00000100:00100000:1.0:1788305174.770262:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788305174.770268:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3302:x1875173761369728:12345-0@lo:400: 00000100:00100000:1.0:1788305174.770303:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3302:x1875173761369728:12345-0@lo:400: Request processed in 35us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305174.770309:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788305174.770341:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761369728:0@lo:400: 00000100:00100000:1.0:1788305174.770355:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370240 00000100:00100000:1.0:1788305174.770357:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370240 00000100:00100000:1.0:1788305174.770380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305174.770385:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761370240:12345-0@lo:400: 00000100:00100000:1.0:1788305174.770412:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761370240:12345-0@lo:400: Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305174.770424:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788305174.770437:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788305174.770453:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d49180 x1875173761370240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305174.770463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761370240:0@lo:400: 00000100:00100000:0.0:1788305174.770675:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370112 00000100:00100000:0.0:1788305174.770679:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370112 00000100:00100000:0.0:1788305174.770717:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305174.770727:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761370112:12345-0@lo:400: 00000100:00080000:2.0:1788305174.770846:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305174.771854:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4a300 x1875173761370112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305174.771869:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761370112:0@lo:400: 00000100:00100000:0.0:1788305174.774977:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761370112:12345-0@lo:400: Request processed in 4239us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305174.774992:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788305175.411493:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788305176.305133:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788305176.305142:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fbb95e7800 from 30 10000000:01000000:0.0:1788305176.305147:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305176.305189:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.305201:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.305212:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305176.305237:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761370368:0@lo:101: 00000100:00100000:0.0:1788305176.305303:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.305357:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.305473:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370368 00000100:00100000:2.0:1788305176.305481:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370368 00000100:00100000:2.0:1788305176.305734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305176.305746:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761370368:12345-0@lo:101: 00010000:00010000:2.0:1788305176.305763:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305176.305777:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae83d1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.305802:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.305814:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.305823:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ce00, rc 0) 00000100:00100000:2.0:1788305176.305868:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761370368:12345-0@lo:101: Request processed in 125us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.305875:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305176.306028:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761370368:0@lo:101: 00010000:00010000:0.0:1788305176.306043:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.306081:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305176.306138:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761370496:0@lo:501: 00000100:00100000:0.0:1788305176.306168:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.306190:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.306204:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370496 00000100:00100000:0.0:1788305176.306208:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370496 00000100:00100000:0.0:1788305176.306237:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305176.306324:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761370496:12345-0@lo:501: 00000100:00100000:0.0:1788305176.309405:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761370496:12345-0@lo:501: Request processed in 3152us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.309419:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305176.309493:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761370496:0@lo:501: 00000100:00100000:0.0:1788305176.309541:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761370624:0@lo:503: 00000100:00100000:0.0:1788305176.309601:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.309643:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.309660:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370624 00000100:00100000:0.0:1788305176.309666:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370624 00000100:00100000:0.0:1788305176.309718:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305176.309728:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761370624:12345-0@lo:503: 00000100:00100000:1.0:1788305176.312094:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761370624:0@lo:503: 00000100:00100000:0.0:1788305176.312395:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761370624:12345-0@lo:503: Request processed in 2296us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.312405:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788305176.312431:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7935:1875173761370752:0@lo:502: 00000100:00100000:2.0:1788305176.312483:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.312514:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370752 00000100:00100000:2.0:1788305176.312519:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370752 00000100:00100000:2.0:1788305176.312549:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305176.312556:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7935:x1875173761370752:12345-0@lo:502: 00000100:00100000:2.0:1788305176.313243:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7935:x1875173761370752:12345-0@lo:502: Request processed in 683us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.313251:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305176.313297:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.313320:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7935:1875173761370752:0@lo:502: 00000100:00100000:2.0:1788305176.313365:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7935:1875173761370880:0@lo:502: 00000100:00100000:2.0:1788305176.313400:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.313902:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.314293:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761370880 00000100:00100000:0.0:1788305176.314305:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761370880 00000100:00100000:1.0:1788305176.314504:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788305176.314517:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7935:x1875173761370880:12345-0@lo:502: 00000100:00100000:1.0:1788305176.316188:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:7935:x1875173761370880:12345-0@lo:502: Request processed in 1667us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.316199:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305176.316388:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7935:1875173761370880:0@lo:502: 00000040:00080000:0.0:1788305176.316423:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788305176.316591:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788305176.316613:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305176.316622:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.316634:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305176.316643:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788305176.316646:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788305176.316649:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788305176.316678:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.316685:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.316706:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305176.316735:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371008:0@lo:101: 00000100:00100000:1.0:1788305176.316770:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.318908:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.319156:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371008 00000100:00100000:0.0:1788305176.319165:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371008 00000100:00100000:0.0:1788305176.319233:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305176.319245:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761371008:12345-0@lo:101: 00010000:00010000:0.0:1788305176.319260:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305176.319279:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae83df expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.319308:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae83df expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.319320:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83df expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.319330:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031800, rc 0) 00000100:00100000:0.0:1788305176.319394:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761371008:12345-0@lo:101: Request processed in 152us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.319401:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305176.319449:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371008:0@lo:101: 00010000:00010000:0.0:1788305176.319464:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.319474:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305176.319540:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371136:0@lo:501: 00000100:00100000:0.0:1788305176.319582:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.319600:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eef000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305176.319662:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371136 00000100:00100000:1.0:1788305176.319668:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371136 00000100:00100000:1.0:1788305176.319702:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788305176.319720:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761371136:12345-0@lo:501: 00000100:00100000:1.0:1788305176.320035:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761371136:12345-0@lo:501: Request processed in 325us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.320041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305176.320135:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371136:0@lo:501: 00000100:00100000:0.0:1788305176.320162:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371264:0@lo:503: 00000100:00100000:0.0:1788305176.320200:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.320221:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eef000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.320233:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371264 00000100:00100000:0.0:1788305176.320236:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371264 00000100:00100000:0.0:1788305176.320254:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788305176.320261:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761371264:12345-0@lo:503: 00000100:00100000:0.0:1788305176.320546:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761371264:12345-0@lo:503: Request processed in 285us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.320553:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788305176.320589:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371264:0@lo:503: 00000100:00100000:0.0:1788305176.320783:0:7936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7936:1875173761371392:0@lo:502: 00000100:00100000:0.0:1788305176.320816:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.320835:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371392 00000100:00100000:0.0:1788305176.320839:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371392 00000100:00100000:0.0:1788305176.320856:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788305176.320862:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:7936:x1875173761371392:12345-0@lo:502: 00000100:00100000:0.0:1788305176.321214:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:7936:x1875173761371392:12345-0@lo:502: Request processed in 351us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.321221:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788305176.321254:0:7936:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.321266:0:7936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7936:1875173761371392:0@lo:502: 00000020:01000000:0.0:1788305176.321293:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305176.321302:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305176.321304:0:7936:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788305176.321308:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788305176.321310:0:7936:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788305176.321325:0:7936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7936:1875173761371520:0@lo:502: 00000100:00100000:0.0:1788305176.321354:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.321378:0:7936:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305176.321440:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371520 00000100:00100000:1.0:1788305176.321445:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371520 00000100:00100000:1.0:1788305176.321474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305176.321481:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:7936:x1875173761371520:12345-0@lo:502: 00000100:00100000:1.0:1788305176.321603:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:7936:x1875173761371520:12345-0@lo:502: Request processed in 122us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.321610:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788305176.322099:0:7936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7936:1875173761371520:0@lo:502: 00000020:01000000:0.0:1788305176.322121:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305176.322126:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305176.322128:0:7936:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788305176.322131:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788305176.322473:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788305176.322494:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788305176.322503:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.322513:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305176.322529:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788305176.322531:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fb8951b000 from 30 10000000:01000000:1.0:1788305176.322534:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305176.322560:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.322568:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.322576:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305176.322590:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371648:0@lo:101: 00000100:00100000:1.0:1788305176.322627:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.322667:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.322738:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371648 00000100:00100000:2.0:1788305176.322744:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371648 00000100:00100000:2.0:1788305176.322775:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788305176.322782:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761371648:12345-0@lo:101: 00010000:00010000:2.0:1788305176.322802:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305176.322814:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae83ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.322843:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.322853:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.322862:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7da00, rc 0) 00000100:00100000:2.0:1788305176.322901:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761371648:12345-0@lo:101: Request processed in 119us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.322907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305176.323132:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371648:0@lo:101: 00010000:00010000:1.0:1788305176.323145:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.323153:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305176.323210:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371776:0@lo:501: 00000100:00100000:1.0:1788305176.323235:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.323264:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.323384:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371776 00000100:00100000:2.0:1788305176.323390:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371776 00000100:00100000:2.0:1788305176.323420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788305176.323426:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761371776:12345-0@lo:501: 00000100:00100000:2.0:1788305176.323647:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761371776:12345-0@lo:501: Request processed in 220us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.323664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788305176.323694:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371776:0@lo:501: 00000100:00100000:2.0:1788305176.323734:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371904:0@lo:503: 00000100:00100000:2.0:1788305176.323772:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.323786:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.323797:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761371904 00000100:00100000:2.0:1788305176.323801:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761371904 00000100:00100000:2.0:1788305176.323832:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788305176.323839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761371904:12345-0@lo:503: 00000100:00100000:2.0:1788305176.324108:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761371904:12345-0@lo:503: Request processed in 269us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.324115:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788305176.324154:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761371904:0@lo:503: 00000100:00100000:0.0:1788305176.324719:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7937:1875173761372032:0@lo:502: 00000100:00100000:0.0:1788305176.324760:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.324907:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372032 00000100:00100000:2.0:1788305176.324913:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372032 00000100:00100000:0.0:1788305176.325121:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eef900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.325320:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788305176.325330:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:7937:x1875173761372032:12345-0@lo:502: 00000100:00100000:2.0:1788305176.325508:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:7937:x1875173761372032:12345-0@lo:502: Request processed in 180us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.325515:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305176.327282:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7937:1875173761372032:0@lo:502: 00000100:00100000:0.0:1788305176.327367:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7937:1875173761372160:0@lo:502: 00000100:00100000:0.0:1788305176.327424:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.332164:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eef900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305176.332835:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372160 00000100:00100000:1.0:1788305176.332845:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372160 00000100:00100000:1.0:1788305176.332904:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788305176.332921:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:7937:x1875173761372160:12345-0@lo:502: 00000100:00100000:1.0:1788305176.333222:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:7937:x1875173761372160:12345-0@lo:502: Request processed in 302us (5796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.333231:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305176.333410:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7937:1875173761372160:0@lo:502: 00000040:00080000:0.0:1788305176.333445:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788305176.333612:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788305176.333634:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305176.333643:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.333653:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305176.333668:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788305176.333671:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fb8951b000 from 5 10000000:01000000:2.0:1788305176.333673:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305176.333701:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.333708:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.333729:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305176.333744:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372288:0@lo:101: 00000100:00100000:2.0:1788305176.333779:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.333812:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.334750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372288 00000100:00100000:0.0:1788305176.334758:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372288 00000100:00100000:0.0:1788305176.334804:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788305176.334813:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761372288:12345-0@lo:101: 00010000:00010000:0.0:1788305176.334824:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305176.334847:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030600/0x902a3611c9ae8402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae83fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.334870:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030600/0x902a3611c9ae8402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae83fb expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.334880:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030600/0x902a3611c9ae8402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83fb expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.334889:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030600, rc 0) 00000100:00100000:0.0:1788305176.334936:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761372288:12345-0@lo:101: Request processed in 124us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.334942:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788305176.335103:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372288:0@lo:101: 00010000:00010000:2.0:1788305176.335117:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305176.335127:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305176.335176:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372416:0@lo:256: 00000100:00100000:2.0:1788305176.335208:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.335266:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.346523:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372416 00000100:00100000:0.0:1788305176.346539:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372416 00000100:00100000:0.0:1788305176.346604:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305176.346615:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761372416:12345-0@lo:256: 20000000:01000000:0.0:1788305176.346641:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788305176.346665:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788305176.346668:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788305176.346832:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761372416:12345-0@lo:256: Request processed in 219us (11622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.346840:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305176.346920:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372416:0@lo:256: 10000000:01000000:0.0:1788305176.346974:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305176.346984:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.346994:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305176.347010:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788305176.347012:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788305176.347015:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788305176.347043:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.347072:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.347081:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305176.347100:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372544:0@lo:101: 00000100:00100000:0.0:1788305176.347135:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.347166:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.347181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372544 00000100:00100000:0.0:1788305176.347185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372544 00000100:00100000:0.0:1788305176.347210:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305176.347216:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761372544:12345-0@lo:101: 00010000:00010000:0.0:1788305176.347225:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305176.347239:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8409 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.347260:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.347271:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.347289:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031000, rc 0) 00000100:00100000:0.0:1788305176.347319:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761372544:12345-0@lo:101: Request processed in 103us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.347325:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305176.347350:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372544:0@lo:101: 00010000:00010000:0.0:1788305176.347362:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.347370:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305176.347411:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372672:0@lo:501: 00000100:00100000:0.0:1788305176.347433:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.347445:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.347456:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372672 00000100:00100000:0.0:1788305176.347460:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372672 00000100:00100000:0.0:1788305176.347477:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305176.347482:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761372672:12345-0@lo:501: 00000100:00100000:0.0:1788305176.347738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761372672:12345-0@lo:501: Request processed in 254us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.347746:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305176.347775:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372672:0@lo:501: 00000100:00100000:0.0:1788305176.347801:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372800:0@lo:503: 00000100:00100000:0.0:1788305176.347840:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.347853:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.347869:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372800 00000100:00100000:0.0:1788305176.347872:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372800 00000100:00100000:0.0:1788305176.347891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788305176.347897:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761372800:12345-0@lo:503: 00000100:00100000:0.0:1788305176.348196:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761372800:12345-0@lo:503: Request processed in 299us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.348204:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788305176.348240:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761372800:0@lo:503: 00000100:00100000:0.0:1788305176.348406:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7938:1875173761372928:0@lo:502: 00000100:00100000:0.0:1788305176.348435:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.348450:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761372928 00000100:00100000:0.0:1788305176.348453:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761372928 00000100:00100000:0.0:1788305176.348471:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788305176.348477:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:7938:x1875173761372928:12345-0@lo:502: 00000100:00100000:0.0:1788305176.348649:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:7938:x1875173761372928:12345-0@lo:502: Request processed in 171us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.348655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788305176.348686:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.348696:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7938:1875173761372928:0@lo:502: 00000020:01000000:0.0:1788305176.348727:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788305176.348734:0:7938:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788305176.348740:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305176.348742:0:7938:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788305176.348746:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788305176.348750:0:7938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:0.0:1788305176.348768:0:7938:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788305176.348770:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305176.348789:0:7938:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96fa818c0000) 00000020:00000080:0.0:1788305176.348809:0:7938:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788305176.348814:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788305176.348874:0:7938:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788305176.348880:0:7938:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788305176.348886:0:7938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae841e 00010000:00080000:0.0:1788305176.348911:0:7938:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fbc1460800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788305176.349146:0:7938:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788305176.354243:0:7938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788305176.354263:0:7938:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788305176.354805:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305176.355022:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305176.355107:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788305176.355165:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788305176.355626:0:7939:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305176.355631:0:7939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788305176.356519:0:7938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305176.356531:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788305176.356564:0:7938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788305176.356587:0:7938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae8425 00000100:00080000:1.0:1788305176.356598:0:7938:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305176.356604:0:7938:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96fbc1460800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305176.356639:0:7938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbb5d4b480 x1875173761373056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305176.356666:0:7938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788305176.356758:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761373056:0@lo:8: 00000100:00100000:2.0:1788305176.356838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.356904:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373056 00000100:00100000:2.0:1788305176.356911:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373056 00000100:00100000:2.0:1788305176.356943:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305176.356950:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875173761373056:12345-0@lo:8: 00010000:00080000:2.0:1788305176.356974:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1788305176.356998:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae842c 00002000:00100000:2.0:1788305176.357012:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96fbaf4f5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788305176.357016:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788305176.357020:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788305176.357142:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788305176.357284:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305176.357306:0:6675:0:(import.c:65:import_set_state_nolock()) ffff96fbaf4f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305176.357354:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875173761373056:12345-0@lo:8: Request processed in 403us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.357361:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788305176.357400:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4b480 x1875173761373056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305176.357410:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305176.357418:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788305176.357425:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788305176.357429:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788305176.357432:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc1460800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788305176.357445:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788305176.357450:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761373056:0@lo:8: 00000004:00080000:2.0:1788305176.357468:0:7939:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788305176.357554:0:7939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 194067500264ns, next at 0ns, rc = 0 00000020:01000000:1.0:1788305176.358897:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305176.358905:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305176.358908:0:7938:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788305176.358912:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305176.358917:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305176.358918:0:7938:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305176.358921:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305176.358923:0:7938:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788305176.358973:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7938:1875173761373184:0@lo:502: 00000100:00100000:1.0:1788305176.359042:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.359084:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305176.361751:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373184 00000100:00100000:1.0:1788305176.361764:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373184 00000100:00100000:1.0:1788305176.361861:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305176.361881:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:7938:x1875173761373184:12345-0@lo:502: 00000100:00100000:1.0:1788305176.362215:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:7938:x1875173761373184:12345-0@lo:502: Request processed in 336us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.362224:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305176.362285:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:7938:1875173761373184:0@lo:502: 00000020:01000000:1.0:1788305176.362317:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305176.362324:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305176.362326:0:7938:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788305176.362330:0:7938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1788305176.366176:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761373312:0@lo:400: 00000100:00100000:1.0:1788305176.366244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.366295:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373312 00000100:00100000:1.0:1788305176.366301:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373312 00000100:00100000:1.0:1788305176.366340:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305176.366349:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761373312:12345-0@lo:400: 00000100:00100000:1.0:1788305176.366396:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761373312:12345-0@lo:400: Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.366403:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788305176.366445:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4ad80 x1875173761373312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305176.366459:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761373312:0@lo:400: 00000100:00100000:1.0:1788305176.366491:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761373440:0@lo:400: 00000100:00100000:1.0:1788305176.366514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.366538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373440 00000100:00100000:1.0:1788305176.366542:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373440 00000100:00100000:1.0:1788305176.366579:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305176.366591:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761373440:12345-0@lo:400: 00000100:00100000:1.0:1788305176.366623:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761373440:12345-0@lo:400: Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.366629:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788305176.366650:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4ad80 x1875173761373440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305176.366659:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761373440:0@lo:400: 00000100:00080000:2.0:1788305176.369047:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305176.369106:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761373568:0@lo:400: 00000100:00100000:2.0:1788305176.369177:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.369220:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305176.369227:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761373696:0@lo:400: 00000100:00100000:2.0:1788305176.369254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.369599:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373568 00000100:00100000:2.0:1788305176.369606:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373568 00000100:00100000:2.0:1788305176.369656:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305176.369664:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761373568:12345-0@lo:400: 00000100:00100000:2.0:1788305176.369724:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761373568:12345-0@lo:400: Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.369730:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305176.369754:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373696 00000100:00100000:2.0:1788305176.369757:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373696 00000100:00100000:2.0:1788305176.369781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305176.369787:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761373696:12345-0@lo:400: 00000020:01000000:0.0:1788305176.370045:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788305176.370156:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305176.370167:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.370179:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305176.370189:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788305176.370191:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96fba05219b8 from 1 10000000:01000000:0.0:1788305176.370195:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305176.370226:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.370234:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305176.370245:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305176.370268:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761373824:0@lo:101: 00000100:00100000:0.0:1788305176.370302:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.370403:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761373696:12345-0@lo:400: Request processed in 615us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305176.370410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788305176.370426:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305176.370429:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305176.370454:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d48a80 x1875173761373696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305176.370467:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761373696:0@lo:400: 00010000:00080000:2.0:1788305176.370478:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4ad80 x1875173761373568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305176.370486:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761373568:0@lo:400: 00000100:00100000:0.0:1788305176.371871:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88eefa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305176.372511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373824 00000100:00100000:1.0:1788305176.372521:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373824 00000100:00100000:1.0:1788305176.372566:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305176.372574:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761373824:12345-0@lo:101: 00010000:00010000:1.0:1788305176.372590:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305176.372607:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.372632:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.372640:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305176.372647:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e600, rc 0) 00000100:00100000:1.0:1788305176.372703:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761373824:12345-0@lo:101: Request processed in 130us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.372719:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788305176.372744:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761373824:0@lo:101: 00010000:00010000:3.0:1788305176.372761:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305176.372782:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305176.373165:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761373952:0@lo:501: 00000100:00100000:3.0:1788305176.373279:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305176.373312:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.373565:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761373952 00000100:00100000:0.0:1788305176.373570:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761373952 00000100:00100000:0.0:1788305176.373603:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305176.373611:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761373952:12345-0@lo:501: 00000100:00100000:0.0:1788305176.373835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761373952:12345-0@lo:501: Request processed in 224us (555us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305176.373844:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788305176.374352:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761373952:0@lo:501: 10000000:01000000:3.0:1788305176.374379:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788305176.374385:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305176.374391:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305176.412424:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788305176.434389:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788305176.440333:0:7940:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788305176.440366:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374208:0@lo:7: 00000100:00100000:0.0:1788305176.440445:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305176.440496:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305176.440504:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305176.440516:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761374080:0@lo:13: 00000100:00100000:0.0:1788305176.440527:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374208 00000100:00100000:0.0:1788305176.440536:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374208 00000100:00100000:3.0:1788305176.440560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.440597:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305176.440609:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7940:x1875173761374208:12345-0@lo:7: 00000100:00100000:3.0:1788305176.440656:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374080 00000100:00100000:3.0:1788305176.440661:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374080 00000100:00100000:3.0:1788305176.440696:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305176.440704:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875173761374080:12345-0@lo:13: 00002000:00000024:3.0:1788305176.440737:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788305176.440785:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875173761374080:12345-0@lo:13: Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305176.440793:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788305176.440837:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a0380 x1875173761374080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305176.440863:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761374080:0@lo:13: 00000100:00080000:2.0:1788305176.442135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788305176.451447:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788305176.451455:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788305176.451605:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7940:x1875173761374208:12345-0@lo:7: Request processed in 10995us (11156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305176.451617:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788305176.451705:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a0a80 x1875173761374208/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305192 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305176.451744:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374208:0@lo:7: 00000004:00080000:1.0:1788305176.451758:0:7940:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788305176.451795:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374336:0@lo:5: 00000100:00100000:1.0:1788305176.451888:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.452026:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.455214:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374336 00000100:00100000:2.0:1788305176.455230:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374336 00000100:00100000:2.0:1788305176.455288:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305176.455300:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7940:x1875173761374336:12345-0@lo:5: 00002000:00080000:2.0:1788305176.455334:0:6675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788305176.455339:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788305176.458170:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7940:x1875173761374336:12345-0@lo:5: Request processed in 2863us (6271us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788305176.458192:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788305176.458628:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4a680 x1875173761374336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305192 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305176.458648:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374336:0@lo:5: 00000004:00080000:1.0:1788305176.458662:0:7940:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788305176.458702:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374464:0@lo:700: 00000100:00100000:1.0:1788305176.459011:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305176.459242:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374464 00000100:00100000:0.0:1788305176.459249:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374464 00000100:00100000:0.0:1788305176.459295:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305176.459313:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7940:x1875173761374464:12345-0@lo:700: 00000100:00100000:0.0:1788305176.459347:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875173761374592:0@lo:700: 00000100:00100000:0.0:1788305176.459374:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305176.459426:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.459551:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305176.459564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374592 00000100:00100000:0.0:1788305176.459567:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374592 00000100:00100000:0.0:1788305176.459627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305176.459635:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875173761374592:12345-0@lo:700: 40000000:02000000:1.0:1788305176.529310:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788305176.535849:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875173761374592:12345-0@lo:700: Request processed in 76203us (76462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305176.535870:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788305176.536041:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a1c00 x1875173761374592/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788305192 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305176.536690:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875173761374592:0@lo:700: 40000000:02000000:2.0:1788305176.536704:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788305176.609455:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788305176.609470:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788305176.610895:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7940:x1875173761374464:12345-0@lo:700: Request processed in 151576us (151876us total) trans 0 rc 0/0 00010000:00080000:1.0:1788305176.611019:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d48a80 x1875173761374464/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788305192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305176.611032:0:7940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788305176.611396:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374464:0@lo:700: 00000100:00100000:2.0:1788305176.611728:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:2.0:1788305176.646559:0:7940:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788305176.652507:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374720:0@lo:5: 00000100:00100000:0.0:1788305176.652575:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305176.652621:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374720 00000100:00100000:2.0:1788305176.652629:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374720 00000100:00100000:0.0:1788305176.652632:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305176.652684:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305176.652693:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7940:x1875173761374720:12345-0@lo:5: 00002000:00080000:3.0:1788305176.661368:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788305176.661387:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788305176.667035:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7940:x1875173761374720:12345-0@lo:5: Request processed in 14336us (14452us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788305176.667049:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788305176.667119:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a0e00 x1875173761374720/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305176.667139:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875173761374720:0@lo:5: 00000004:00080000:0.0:1788305176.667153:0:7940:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1788305176.738006:0:7981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788305176.820382:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305176.820410:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761374848:0@lo:13: 00000100:00100000:2.0:1788305176.820481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305176.820586:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374848 00000100:00100000:3.0:1788305176.820595:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374848 00000100:00100000:3.0:1788305176.820683:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305176.820693:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761374848:12345-0@lo:13: 00002000:00000024:3.0:1788305176.820738:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305176.820786:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761374848:12345-0@lo:13: Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305176.820793:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788305176.823098:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0599500 x1875173761374848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305176.823124:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761374848:0@lo:13: 00010000:00010000:0.0:1788305177.459707:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305178.482950:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305179.509077:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305180.533673:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305181.426009:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761374976:0@lo:400: 00000100:00100000:1.0:1788305181.426097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305181.426151:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761375488:0@lo:400: 00000100:00100000:1.0:1788305181.426226:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305181.426283:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375488 00000100:00100000:1.0:1788305181.426290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375488 00000100:00100000:1.0:1788305181.426344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788305181.426454:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761374976 00000100:00100000:3.0:1788305181.426458:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761374976 00000100:00100000:3.0:1788305181.426500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788305181.426508:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761374976:12345-0@lo:400: 00000100:00100000:3.0:1788305181.426562:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761374976:12345-0@lo:400: Request processed in 55us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305181.426569:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305181.426738:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761375104:0@lo:400: 00000100:00100000:0.0:1788305181.426770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305181.426790:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761375616:0@lo:400: 00000100:00100000:0.0:1788305181.426830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305181.426908:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761375488:12345-0@lo:400: 00000100:00100000:1.0:1788305181.426943:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761375488:12345-0@lo:400: Request processed in 591us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305181.426950:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305181.426962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375104 00000100:00100000:1.0:1788305181.426965:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375104 00000100:00100000:1.0:1788305181.426981:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305181.426986:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761375104:12345-0@lo:400: 00000100:00100000:1.0:1788305181.427014:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761375104:12345-0@lo:400: Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305181.427019:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788305181.427036:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305181.427078:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761374976:0@lo:400: 00010000:00080000:1.0:1788305181.427092:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a3800 x1875173761375488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305181.427103:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761375488:0@lo:400: 00010000:00080000:0.0:1788305181.427248:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a2a00 x1875173761375104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305181.427257:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761375104:0@lo:400: 00000100:00100000:0.0:1788305181.427282:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761375232:0@lo:400: 00000100:00100000:0.0:1788305181.427312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305181.427338:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305181.427343:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761375360:0@lo:400: 00000100:00100000:1.0:1788305181.428994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375232 00000100:00100000:1.0:1788305181.429003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375232 00000100:00100000:1.0:1788305181.429093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305181.429104:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761375232:12345-0@lo:400: 00000100:00100000:1.0:1788305181.429158:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761375232:12345-0@lo:400: Request processed in 57us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305181.429174:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788305181.429249:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305181.429290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788305181.429385:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a0000 x1875173761375232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305181.429396:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761375232:0@lo:400: 00000100:00100000:3.0:1788305181.429899:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375616 00000100:00100000:3.0:1788305181.429906:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375616 00000100:00100000:3.0:1788305181.430002:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375360 00000100:00100000:3.0:1788305181.430006:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375360 00000100:00100000:3.0:1788305181.430026:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305181.430034:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761375616:12345-0@lo:400: 00000100:00100000:3.0:1788305181.430125:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761375616:12345-0@lo:400: Request processed in 92us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305181.430133:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305181.430146:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305181.430151:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761375360:12345-0@lo:400: 00000100:00100000:3.0:1788305181.430184:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761375360:12345-0@lo:400: Request processed in 32us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305181.430189:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788305181.430291:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305181.430294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788305181.430784:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a3100 x1875173761375360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305181.430797:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761375360:0@lo:400: 00010000:00080000:0.0:1788305181.430828:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a2300 x1875173761375616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305181.430892:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761375616:0@lo:400: 00010000:00010000:0.0:1788305181.555459:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305181.941136:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761375744:0@lo:13: 00000100:00100000:3.0:1788305181.941212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305181.941903:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375744 00000100:00100000:3.0:1788305181.941912:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375744 00000100:00100000:0.0:1788305181.944128:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305181.944147:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761375744:12345-0@lo:13: 00002000:00000024:0.0:1788305181.944186:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305181.945025:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761375744:12345-0@lo:13: Request processed in 119us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305181.945038:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788305181.945211:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a2300 x1875173761375744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305181.945235:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761375744:0@lo:13: 00000100:00100000:2.0:1788305181.946185:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305181.946198:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761375872:0@lo:13: 00000100:00100000:2.0:1788305181.946255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305181.947561:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761375872 00000100:00100000:1.0:1788305181.947572:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761375872 00000100:00100000:1.0:1788305181.947682:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788305181.947693:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761375872:12345-0@lo:13: 00002000:00000024:1.0:1788305181.947728:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305181.947790:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761375872:12345-0@lo:13: Request processed in 100us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305181.947798:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788305181.950695:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba059a300 x1875173761375872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305181.950722:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761375872:0@lo:13: 00000001:00080000:3.0:1788305181.971757:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788305182.578043:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305182.694947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305182.696165:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741428864 00000100:00100000:3.0:1788305182.696178:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741428864 00000100:00100000:3.0:1788305182.696222:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:3.0:1788305182.696231:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1875173741428864:12345-192.168.201.38@tcp:250: 00010000:00080000:3.0:1788305182.696261:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6@192.168.201.38@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788305182.696304:0:5826:0:(genops.c:1385:class_connect()) connect: client e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6, cookie 0x902a3611c9ae8441 00000100:00080000:3.0:1788305182.696440:0:5826:0:(import.c:65:import_set_state_nolock()) ffff96fbaf553800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305182.696524:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+5:2346:x1875173741428864:12345-192.168.201.38@tcp:250: Request processed in 292us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305182.696533:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:3.0:1788305182.702479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305182.702653:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741428992 00000100:00100000:0.0:1788305182.702664:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741428992 00000100:00100000:0.0:1788305182.702718:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:0.0:1788305182.702729:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+5:5576:x1875173741428992:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1788305182.702745:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305182.702762:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a2f5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305182.702791:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305182.702813:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305182.703310:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031600, rc 0) 00000100:00100000:0.0:1788305182.703447:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+6:5576:x1875173741428992:12345-192.168.201.38@tcp:101: Request processed in 719us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305182.703455:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:0.0:1788305182.715824:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305182.715946:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429120 00000100:00100000:3.0:1788305182.715956:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429120 00000100:00100000:3.0:1788305182.716013:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:3.0:1788305182.716023:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+6:5576:x1875173741429120:12345-192.168.201.38@tcp:501: 00000100:00100000:3.0:1788305182.716384:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+6:5576:x1875173741429120:12345-192.168.201.38@tcp:501: Request processed in 361us (584us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305182.716393:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:2.0:1788305182.741261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305182.742440:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429248 00000100:00100000:1.0:1788305182.742455:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429248 00000100:00100000:1.0:1788305182.742514:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:1.0:1788305182.742524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+6:5576:x1875173741429248:12345-192.168.201.38@tcp:101: 00010000:00010000:1.0:1788305182.742539:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305182.742555:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a2fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305182.742581:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305182.742591:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305182.742610:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ec00, rc 0) 00000100:00100000:1.0:1788305182.742671:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+7:5576:x1875173741429248:12345-192.168.201.38@tcp:101: Request processed in 148us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.742691:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:2.0:1788305182.749557:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305182.749680:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429376 00000100:00100000:3.0:1788305182.749690:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429376 00000100:00100000:3.0:1788305182.749744:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:3.0:1788305182.749754:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+7:5576:x1875173741429376:12345-192.168.201.38@tcp:501: 00000100:00100000:3.0:1788305182.750630:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5576:x1875173741429376:12345-192.168.201.38@tcp:501: Request processed in 872us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305182.750640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:2.0:1788305182.756155:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305182.756433:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429504 00000100:00100000:3.0:1788305182.756442:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429504 00000100:00100000:3.0:1788305182.756501:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:3.0:1788305182.756512:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5576:x1875173741429504:12345-192.168.201.38@tcp:503: 00000100:00100000:3.0:1788305182.756896:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5576:x1875173741429504:12345-192.168.201.38@tcp:503: Request processed in 384us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305182.756904:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:0.0:1788305182.769648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305182.769757:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429632 00000100:00100000:1.0:1788305182.769767:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429632 00000100:00100000:1.0:1788305182.769964:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:1.0:1788305182.769976:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5594:x1875173741429632:12345-192.168.201.38@tcp:502: 00000100:00100000:1.0:1788305182.770372:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5594:x1875173741429632:12345-192.168.201.38@tcp:502: Request processed in 397us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.770381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:2.0:1788305182.822819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305182.822906:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429760 00000100:00100000:3.0:1788305182.822917:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429760 00000100:00100000:3.0:1788305182.822977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:3.0:1788305182.822988:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5594:x1875173741429760:12345-192.168.201.38@tcp:502: 00000100:00100000:3.0:1788305182.823285:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5594:x1875173741429760:12345-192.168.201.38@tcp:502: Request processed in 298us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305182.823293:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:0.0:1788305182.830757:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305182.830944:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741429888 00000100:00100000:2.0:1788305182.830954:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741429888 00000100:00100000:2.0:1788305182.831013:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:2.0:1788305182.831023:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5576:x1875173741429888:12345-192.168.201.38@tcp:101: 00010000:00010000:2.0:1788305182.831039:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305182.831077:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7d600/0x902a3611c9ae8456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a326 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305182.831106:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7d600/0x902a3611c9ae8456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a326 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305182.831119:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7d600/0x902a3611c9ae8456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a326 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305182.831128:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d600, rc 0) 00000100:00100000:2.0:1788305182.831183:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5576:x1875173741429888:12345-192.168.201.38@tcp:101: Request processed in 161us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305182.831204:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:2.0:1788305182.835105:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305182.835196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430016 00000100:00100000:0.0:1788305182.835219:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430016 00000100:00100000:0.0:1788305182.835276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:0.0:1788305182.835286:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5576:x1875173741430016:12345-192.168.201.38@tcp:256: 20000000:01000000:0.0:1788305182.835310:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788305182.835341:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788305182.835345:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788305182.835348:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788305182.835350:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788305182.845959:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5576:x1875173741430016:12345-192.168.201.38@tcp:256: Request processed in 10663us (10853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305182.845975:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:3.0:1788305182.854445:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305182.854596:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430144 00000100:00100000:1.0:1788305182.854624:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430144 00000100:00100000:1.0:1788305182.854676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:1.0:1788305182.854687:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5576:x1875173741430144:12345-192.168.201.38@tcp:101: 00010000:00010000:1.0:1788305182.854704:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305182.854723:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a32d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305182.854750:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305182.854761:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305182.854771:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305182.854836:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5576:x1875173741430144:12345-192.168.201.38@tcp:101: Request processed in 150us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.854843:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:3.0:1788305182.857755:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305182.857972:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430272 00000100:00100000:1.0:1788305182.857997:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430272 00000100:00100000:1.0:1788305182.858071:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:1.0:1788305182.858082:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5576:x1875173741430272:12345-192.168.201.38@tcp:501: 00000100:00100000:1.0:1788305182.858554:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5576:x1875173741430272:12345-192.168.201.38@tcp:501: Request processed in 472us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.858562:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:3.0:1788305182.866420:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305182.866622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430400 00000100:00100000:1.0:1788305182.866631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430400 00000100:00100000:1.0:1788305182.866688:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:1.0:1788305182.866699:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5576:x1875173741430400:12345-192.168.201.38@tcp:503: 00000100:00100000:1.0:1788305182.867113:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5576:x1875173741430400:12345-192.168.201.38@tcp:503: Request processed in 414us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.867121:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:3.0:1788305182.870673:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305182.870905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430528 00000100:00100000:1.0:1788305182.870913:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430528 00000100:00100000:1.0:1788305182.870964:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:1.0:1788305182.870974:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5600:x1875173741430528:12345-192.168.201.38@tcp:502: 00000100:00100000:1.0:1788305182.871251:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5600:x1875173741430528:12345-192.168.201.38@tcp:502: Request processed in 277us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.871258:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1788305182.873575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305182.873667:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430656 00000100:00100000:3.0:1788305182.873676:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430656 00000100:00100000:3.0:1788305182.873729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:3.0:1788305182.873740:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5600:x1875173741430656:12345-192.168.201.38@tcp:502: 00000100:00100000:3.0:1788305182.873969:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5600:x1875173741430656:12345-192.168.201.38@tcp:502: Request processed in 231us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305182.873976:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:2.0:1788305182.881161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305182.881669:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430784 00000100:00100000:0.0:1788305182.881680:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430784 00000100:00100000:0.0:1788305182.881735:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1788305182.881744:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875173741430784:12345-192.168.201.38@tcp:38: 00010000:00080000:0.0:1788305182.881772:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1788305182.881816:0:5832:0:(genops.c:1385:class_connect()) connect: client 5455d24f-893c-4899-b5f9-16679e9a93aa, cookie 0x902a3611c9ae8464 00000004:00100000:0.0:1788305182.882714:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788305182.882721:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788305182.945144:0:5832:0:(import.c:65:import_set_state_nolock()) ffff96fbb9e7d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305182.945221:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2346:x1875173741430784:12345-192.168.201.38@tcp:38: Request processed in 63475us (64069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305182.945231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00010000:00010000:0.0:1788305183.601303:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305183.958793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305183.959298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431040 00000100:00100000:1.0:1788305183.959310:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431040 00000100:00100000:1.0:1788305183.959399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1788305183.959410:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5576:x1875173741431040:12345-192.168.201.38@tcp:41: 00000004:00000024:1.0:1788305183.959452:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788305183.959534:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5576:x1875173741431040:12345-192.168.201.38@tcp:41: Request processed in 124us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305183.959542:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00080000:3.0:1788305183.960092:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305183.960719:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305183.961021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741430912 00000100:00100000:1.0:1788305183.961029:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741430912 00000100:00100000:1.0:1788305183.961097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305183.961107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:0:x1875173741430912:12345-192.168.201.38@tcp:41: 00000004:00000024:1.0:1788305183.961143:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788305183.961195:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:0:x1875173741430912:12345-192.168.201.38@tcp:41: Request processed in 90us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305183.961203:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1788305183.970217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305183.970355:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431168 00000100:00100000:2.0:1788305183.970365:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431168 00000100:00100000:2.0:1788305183.970420:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1788305183.970429:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5576:x1875173741431168:12345-192.168.201.38@tcp:40: 00000100:00100000:2.0:1788305183.970506:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5576:x1875173741431168:12345-192.168.201.38@tcp:40: Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305183.970514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788305184.011985:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305184.012031:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305184.012090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305184.012122:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305184.012159:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431296 00000100:00100000:0.0:1788305184.012169:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431296 00000100:00100000:0.0:1788305184.012204:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431424 00000100:00100000:0.0:1788305184.012220:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431424 00000100:00100000:0.0:1788305184.012236:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788305184.012244:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875173741431296:12345-192.168.201.38@tcp:8: 00010000:00080000:0.0:1788305184.012274:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1788305184.012304:0:6678:0:(genops.c:1385:class_connect()) connect: client 5455d24f-893c-4899-b5f9-16679e9a93aa, cookie 0x902a3611c9ae846b 00002000:00100000:0.0:1788305184.012316:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5455d24f-893c-4899-b5f9-16679e9a93aa/ffff96fa82773000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305184.012339:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305184.012680:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788305184.012709:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fa82775800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305184.012770:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2346:x1875173741431296:12345-192.168.201.38@tcp:8: Request processed in 525us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305184.014919:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788305184.014956:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1788305184.014964:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875173741431424:12345-192.168.201.38@tcp:8: 00010000:00080000:0.0:1788305184.014997:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1788305184.015026:0:6678:0:(genops.c:1385:class_connect()) connect: client 5455d24f-893c-4899-b5f9-16679e9a93aa, cookie 0x902a3611c9ae8472 00002000:00100000:0.0:1788305184.015887:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5455d24f-893c-4899-b5f9-16679e9a93aa/ffff96fa82772800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305184.015912:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788305184.016226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431680 00000100:00100000:3.0:1788305184.016235:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431680 00000100:00100000:3.0:1788305184.016280:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:3.0:1788305184.016289:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2347:x1875173741431680:12345-192.168.201.38@tcp:400: 00000100:00100000:3.0:1788305184.016357:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2347:x1875173741431680:12345-192.168.201.38@tcp:400: Request processed in 68us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305184.016365:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:1.0:1788305184.016911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431552 00000100:00100000:1.0:1788305184.016917:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431552 00000100:00100000:1.0:1788305184.016956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305184.016964:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5576:x1875173741431552:12345-192.168.201.38@tcp:33: 00002000:00080000:0.0:1788305184.018909:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788305184.018947:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fa82774000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305184.019013:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2346:x1875173741431424:12345-192.168.201.38@tcp:8: Request processed in 4047us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305184.019022:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000004:00080000:1.0:1788305184.064094:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46999us 00000004:00200000:3.0:1788305184.105539:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788305184.105746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5576:x1875173741431552:12345-192.168.201.38@tcp:33: Request processed in 88776us (93708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305184.105759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305184.535399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305184.535555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431808 00000100:00100000:2.0:1788305184.535577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431808 00000100:00100000:2.0:1788305184.535667:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1788305184.535680:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5617:x1875173741431808:12345-192.168.201.38@tcp:101: 00010000:00010000:2.0:1788305184.535706:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305184.538584:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a357 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305184.538688:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae8480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305184.538703:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae8480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305184.538892:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae8480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305184.539683:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788305184.539696:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305184.540033:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae8480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305184.540358:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a357 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305184.540382:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae8480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a357 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305184.540392:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992a00) 00010000:00010000:2.0:1788305184.540395:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305184.540399:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7dc00, rc 0) 00000100:00100000:2.0:1788305184.540555:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:5617:x1875173741431808:12345-192.168.201.38@tcp:101: Request processed in 4876us (5171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305184.540565:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00010000:00010000:0.0:1788305184.625542:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305185.659965:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305186.545382:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761376000:0@lo:400: 00000100:00100000:1.0:1788305186.545452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305186.545509:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761376512:0@lo:400: 00000100:00100000:1.0:1788305186.545549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305186.545574:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305186.545592:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761376128:0@lo:400: 00000100:00100000:1.0:1788305186.545613:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305186.545627:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761376640:0@lo:400: 00000100:00100000:1.0:1788305186.545646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305186.545673:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376512 00000100:00100000:1.0:1788305186.545680:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376512 00000100:00100000:1.0:1788305186.545725:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376128 00000100:00100000:1.0:1788305186.545728:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376128 00000100:00100000:1.0:1788305186.545744:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305186.545753:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761376512:12345-0@lo:400: 00000100:00100000:2.0:1788305186.545758:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761376256:0@lo:400: 00000100:00100000:2.0:1788305186.545801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305186.545819:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761376512:12345-0@lo:400: Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305186.545827:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305186.545828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305186.545836:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761376384:0@lo:400: 00000100:00100000:1.0:1788305186.545846:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376256 00000100:00100000:1.0:1788305186.545850:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376256 00000100:00100000:2.0:1788305186.545863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305186.545871:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305186.545879:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761376128:12345-0@lo:400: 00000100:00100000:2.0:1788305186.545906:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305186.545913:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761376128:12345-0@lo:400: Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305186.545916:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788305186.545923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305186.545937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305186.545943:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761376256:12345-0@lo:400: 00000100:00100000:1.0:1788305186.545974:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761376256:12345-0@lo:400: Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305186.545980:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305186.546040:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761376256:0@lo:400: 00000100:00100000:1.0:1788305186.546090:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761376128:0@lo:400: 00000100:00100000:1.0:1788305186.546104:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761376512:0@lo:400: 00000100:00100000:3.0:1788305186.546222:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376000 00000100:00100000:3.0:1788305186.546226:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376000 00000100:00100000:3.0:1788305186.546252:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788305186.546258:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761376000:12345-0@lo:400: 00000100:00100000:3.0:1788305186.546293:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761376000:12345-0@lo:400: Request processed in 34us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305186.546298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788305186.546323:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376640 00000100:00100000:3.0:1788305186.546326:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376640 00000100:00100000:3.0:1788305186.546347:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376384 00000100:00100000:3.0:1788305186.546349:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376384 00000100:00100000:3.0:1788305186.546361:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305186.546367:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761376640:12345-0@lo:400: 00000100:00100000:3.0:1788305186.546392:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761376640:12345-0@lo:400: Request processed in 25us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305186.546398:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305186.546407:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305186.546412:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761376384:12345-0@lo:400: 00000100:00080000:0.0:1788305186.546482:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305186.546486:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305186.546489:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305186.546511:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc16af100 x1875173761376640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305186.546520:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788305186.546530:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761376640:0@lo:400: 00000100:00100000:0.0:1788305186.546554:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761376000:0@lo:400: 00000100:00100000:3.0:1788305186.563372:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761376384:12345-0@lo:400: Request processed in 16947us (17497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305186.563386:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788305186.566082:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc16ac700 x1875173761376384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305186.566101:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761376384:0@lo:400: 00010000:00010000:0.0:1788305186.674212:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305187.057396:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305187.057422:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761376768:0@lo:13: 00000100:00100000:1.0:1788305187.057488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305187.057871:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376768 00000100:00100000:0.0:1788305187.057879:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376768 00000100:00100000:0.0:1788305187.057928:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305187.057937:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761376768:12345-0@lo:13: 00002000:00000024:0.0:1788305187.057971:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305187.058025:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761376768:12345-0@lo:13: Request processed in 88us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305187.058031:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788305187.058721:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a0e00 x1875173761376768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305187.058743:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761376768:0@lo:13: 00000100:00100000:1.0:1788305187.060800:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761376896:0@lo:13: 00000100:00100000:1.0:1788305187.060881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305187.060946:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761376896 00000100:00100000:0.0:1788305187.060956:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761376896 00000100:00100000:0.0:1788305187.061013:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305187.061024:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761376896:12345-0@lo:13: 00002000:00000024:0.0:1788305187.061082:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305187.061147:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761376896:12345-0@lo:13: Request processed in 125us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305187.061154:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788305187.061296:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0598380 x1875173761376896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305187.061328:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761376896:0@lo:13: 00000100:00100000:1.0:1788305187.513148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305187.514822:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741431936 00000100:00100000:2.0:1788305187.514835:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741431936 00000100:00080000:0.0:1788305187.515040:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305187.515228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1788305187.515241:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:5670:x1875173741431936:12345-192.168.201.38@tcp:41: 00000004:00000024:2.0:1788305187.515285:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788305187.515836:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:5670:x1875173741431936:12345-192.168.201.38@tcp:41: Request processed in 595us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305187.515844:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1788305187.531485:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305187.531620:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432064 00000100:00100000:0.0:1788305187.531646:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432064 00000100:00080000:3.0:1788305187.531715:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305187.531728:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1788305187.531739:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5670:x1875173741432064:12345-192.168.201.38@tcp:13: 00002000:00000024:0.0:1788305187.531779:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305187.531848:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5670:x1875173741432064:12345-192.168.201.38@tcp:13: Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305187.531855:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1788305187.535118:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305187.535594:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432192 00000100:00100000:3.0:1788305187.535617:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432192 00000100:00100000:3.0:1788305187.535706:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00080000:0.0:1788305187.535910:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305187.535968:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5670:x1875173741432192:12345-192.168.201.38@tcp:13: 00002000:00000024:3.0:1788305187.536007:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305187.536118:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5455d24f-893c-4899-b5f9-16679e9a93aa+6:5670:x1875173741432192:12345-192.168.201.38@tcp:13: Request processed in 385us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305187.536137:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00010000:00010000:0.0:1788305187.698199:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788305188.197635:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00010000:00010000:2.0:1788305188.721186:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305188.764630:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000100:00100000:2.0:1788305189.001423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305189.001485:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305189.001525:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432320 00000100:00100000:0.0:1788305189.001541:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432320 00000100:00100000:0.0:1788305189.001636:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:0.0:1788305189.001648:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741432320:12345-192.168.201.38@tcp:400: 00000100:00100000:0.0:1788305189.001735:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741432320:12345-192.168.201.38@tcp:400: Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305189.001742:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:1.0:1788305189.002215:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432576 00000100:00100000:1.0:1788305189.002221:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432576 00000100:00100000:1.0:1788305189.002279:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305189.002289:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741432576:12345-192.168.201.38@tcp:400: 00000100:00100000:1.0:1788305189.002344:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741432576:12345-192.168.201.38@tcp:400: Request processed in 57us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305189.002351:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00080000:0.0:1788305189.002682:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305189.002850:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305189.002912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432448 00000100:00100000:1.0:1788305189.002912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305189.002933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432448 00000100:00100000:2.0:1788305189.003013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1788305189.003024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741432448:12345-192.168.201.38@tcp:400: 00000100:00100000:2.0:1788305189.003140:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741432448:12345-192.168.201.38@tcp:400: Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305189.003148:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00080000:0.0:1788305189.003246:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305189.003375:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432704 00000100:00100000:3.0:1788305189.003381:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432704 00000100:00100000:3.0:1788305189.003425:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788305189.003433:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741432704:12345-192.168.201.38@tcp:400: 00000100:00080000:0.0:1788305189.003444:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305189.003478:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741432704:12345-192.168.201.38@tcp:400: Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305189.003485:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000001:00100000:0.0:1788305189.226886:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00010000:00010000:0.0:1788305189.745302:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788305190.672196:0:8288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788305190.775504:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305191.667397:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761377152:0@lo:400: 00000100:00100000:3.0:1788305191.667508:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305191.667586:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761377664:0@lo:400: 00000100:00100000:3.0:1788305191.667623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305191.667679:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788305191.667688:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761377024:0@lo:400: 00000100:00100000:3.0:1788305191.667727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305191.667755:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761377536:0@lo:400: 00000100:00100000:3.0:1788305191.667787:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305191.667814:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761377280:0@lo:400: 00000100:00100000:3.0:1788305191.667836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305191.667856:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305191.667861:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761377408:0@lo:400: 00000100:00100000:3.0:1788305191.667890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305191.667923:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377664 00000100:00100000:3.0:1788305191.667932:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377664 00000100:00100000:3.0:1788305191.667999:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377408 00000100:00100000:3.0:1788305191.668003:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377408 00000100:00100000:3.0:1788305191.668024:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305191.668033:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761377664:12345-0@lo:400: 00000100:00100000:3.0:1788305191.668136:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761377664:12345-0@lo:400: Request processed in 103us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305191.668144:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305191.668164:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305191.668170:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761377408:12345-0@lo:400: 00000100:00100000:3.0:1788305191.668199:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761377408:12345-0@lo:400: Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305191.668204:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305191.668222:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377024 00000100:00100000:3.0:1788305191.668226:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377024 00000100:00100000:3.0:1788305191.668252:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788305191.668258:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761377024:12345-0@lo:400: 00000100:00100000:3.0:1788305191.668288:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761377024:12345-0@lo:400: Request processed in 30us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305191.668294:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788305191.668339:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377152 00000100:00100000:3.0:1788305191.668343:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377152 00000100:00100000:3.0:1788305191.668370:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377536 00000100:00100000:3.0:1788305191.668373:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377536 00000100:00100000:3.0:1788305191.668386:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377280 00000100:00100000:3.0:1788305191.668389:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377280 00000100:00100000:3.0:1788305191.668413:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305191.668418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761377152:12345-0@lo:400: 00000100:00100000:3.0:1788305191.668459:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761377152:12345-0@lo:400: Request processed in 41us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305191.668465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305191.668476:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305191.668483:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761377536:12345-0@lo:400: 00000100:00100000:3.0:1788305191.668510:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761377536:12345-0@lo:400: Request processed in 28us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305191.668515:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305191.668526:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305191.668532:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761377280:12345-0@lo:400: 00000100:00100000:3.0:1788305191.668557:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761377280:12345-0@lo:400: Request processed in 26us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305191.668563:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788305191.668589:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305191.668595:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305191.668597:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305191.668629:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761377024:0@lo:400: 00000100:00100000:3.0:1788305191.668643:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761377536:0@lo:400: 00000100:00100000:3.0:1788305191.668653:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761377152:0@lo:400: 00010000:00080000:3.0:1788305191.668665:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a96d80 x1875173761377664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305191.668677:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761377664:0@lo:400: 00010000:00080000:3.0:1788305191.668720:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a96680 x1875173761377408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305191.668736:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761377408:0@lo:400: 00000100:00100000:3.0:1788305191.668747:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761377280:0@lo:400: 00010000:00010000:0.0:1788305191.793725:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305192.178005:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305192.178045:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761377792:0@lo:13: 00000100:00100000:1.0:1788305192.178185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305192.178284:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377792 00000100:00100000:1.0:1788305192.178294:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377792 00000100:00100000:1.0:1788305192.178365:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305192.178400:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761377792:12345-0@lo:13: 00000100:00100000:2.0:1788305192.178455:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761377920:0@lo:13: 00002000:00000024:1.0:1788305192.178472:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305192.178540:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761377792:12345-0@lo:13: Request processed in 145us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305192.178559:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305192.178560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305192.178591:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761377920 00000100:00100000:1.0:1788305192.178598:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761377920 00000100:00100000:1.0:1788305192.178627:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305192.178636:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761377920:12345-0@lo:13: 00010000:00080000:2.0:1788305192.178666:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a94380 x1875173761377792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305192.178691:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761377792:0@lo:13: 00002000:00000024:1.0:1788305192.179086:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305192.179150:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761377920:12345-0@lo:13: Request processed in 515us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305192.179157:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788305192.179241:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0598700 x1875173761377920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305192.179274:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761377920:0@lo:13: 00010000:00010000:2.0:1788305192.819632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305193.843959:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305194.131022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305194.131150:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305194.131202:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305194.131241:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305194.131271:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433088 00000100:00100000:1.0:1788305194.131282:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433088 00000100:00100000:1.0:1788305194.131340:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433216 00000100:00100000:1.0:1788305194.131343:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433216 00000100:00100000:1.0:1788305194.131363:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788305194.131373:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741433088:12345-192.168.201.38@tcp:400: 00000100:00100000:1.0:1788305194.131451:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741433088:12345-192.168.201.38@tcp:400: Request processed in 80us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305194.131460:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788305194.131478:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305194.131498:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741433216:12345-192.168.201.38@tcp:400: 00000100:00100000:1.0:1788305194.131522:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741433216:12345-192.168.201.38@tcp:400: Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305194.131529:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00080000:1.0:1788305194.131545:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305194.131549:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305194.133621:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432960 00000100:00100000:0.0:1788305194.133631:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432960 00000100:00080000:1.0:1788305194.133704:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305194.133713:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:0.0:1788305194.133724:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741432960:12345-192.168.201.38@tcp:400: 00000100:00100000:0.0:1788305194.133787:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741432960:12345-192.168.201.38@tcp:400: Request processed in 65us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305194.133794:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788305194.137553:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741432832 00000100:00100000:3.0:1788305194.137569:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741432832 00000100:00100000:3.0:1788305194.138424:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:3.0:1788305194.138438:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741432832:12345-192.168.201.38@tcp:400: 00000100:00100000:3.0:1788305194.138512:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741432832:12345-192.168.201.38@tcp:400: Request processed in 78us (7499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305194.138519:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00010000:00010000:2.0:1788305194.865230:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788305195.528425:0:8437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff79d8570 20000000:00000080:3.0:1788305195.528441:0:8437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fbaf266c00 uarg=0000000000000000 20000000:01000000:3.0:1788305195.528473:0:8437:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788305195.528475:0:8437:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788305195.528477:0:8437:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788305195.528482:0:8437:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788305195.528486:0:8437:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788305195.528497:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788305195.528500:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788305195.528738:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788305195.528741:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788305195.529769:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788305195.530354:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788305195.530415:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788305195.530447:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788305195.530457:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788305195.530460:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788305195.531353:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788305195.531735:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788305195.531788:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788305195.531831:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788305195.531950:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788305195.531953:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788305195.532529:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788305195.532975:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788305195.533027:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788305195.533160:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788305195.533172:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788305195.533174:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788305195.533747:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788305195.534357:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788305195.534409:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788305195.534454:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1788305195.534468:0:8437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788305195.534486:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534503:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae837d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534511:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534519:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534526:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83df expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534533:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534539:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534555:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534564:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534571:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534578:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534680:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534694:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 9 pid: 5826 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.534707:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378048:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305195.534973:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.534982:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 9 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.534991:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378176:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305195.535020:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535038:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 18 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535047:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378304:0@lo:104: 00000100:00100000:3.0:1788305195.535127:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305195.535166:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535175:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 18 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535183:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378432:0@lo:104: 00000100:00100000:3.0:1788305195.535206:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305195.535223:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535231:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 18 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535238:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378560:0@lo:104: 00010000:00010000:3.0:1788305195.535256:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae83df expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535264:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae83df expref: 18 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535271:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378688:0@lo:104: 00010000:00010000:3.0:1788305195.535288:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535300:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 18 pid: 5826 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535309:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378816:0@lo:104: 00010000:00010000:3.0:1788305195.535327:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535334:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 18 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535342:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378944:0@lo:104: 00010000:00010000:3.0:1788305195.535357:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae837d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.535365:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae837d expref: 18 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305195.535372:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761379072:0@lo:104: 00000100:00100000:3.0:1788305195.535399:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305195.535468:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788305195.535484:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305195.535495:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305195.535503:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305195.535510:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305195.535517:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305195.535524:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761378304 00000100:00100000:1.0:1788305195.535529:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761378304 00000100:00100000:1.0:1788305195.535556:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761378432 00000100:00100000:1.0:1788305195.535558:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761378432 00000100:00100000:1.0:1788305195.535566:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761378560 00000100:00100000:1.0:1788305195.535568:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761378560 00000100:00100000:1.0:1788305195.535576:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761378688 00000100:00100000:1.0:1788305195.535578:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761378688 00000100:00100000:1.0:1788305195.535584:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761378816 00000100:00100000:1.0:1788305195.535587:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761378816 00000100:00100000:1.0:1788305195.535594:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761378944 00000100:00100000:1.0:1788305195.535607:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761378944 00000100:00100000:1.0:1788305195.535616:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379072 00000100:00100000:1.0:1788305195.535618:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379072 00000100:00100000:1.0:1788305195.535629:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305195.535642:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:8437:x1875173761378304:12345-0@lo:104: 00010000:00010000:1.0:1788305195.535653:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.535704:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305195.535710:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+9:8437:x1875173761378304:12345-0@lo:104: Request processed in 69us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.535716:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305195.535731:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305195.535736:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+8:8437:x1875173761378432:12345-0@lo:104: 00010000:00010000:1.0:1788305195.535743:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.535769:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788305195.535774:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+8:8437:x1875173761378432:12345-0@lo:104: Request processed in 38us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.535779:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305195.535807:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305195.535813:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+7:8437:x1875173761378560:12345-0@lo:104: 00010000:00010000:1.0:1788305195.535820:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.536000:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788305195.536006:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+7:8437:x1875173761378560:12345-0@lo:104: Request processed in 193us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.536011:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305195.536024:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305195.536034:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+6:8437:x1875173761378688:12345-0@lo:104: 00010000:00010000:1.0:1788305195.536041:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.536088:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788305195.536093:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+6:8437:x1875173761378688:12345-0@lo:104: Request processed in 60us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.536099:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305195.536111:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305195.536116:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+5:8437:x1875173761378816:12345-0@lo:104: 00010000:00010000:1.0:1788305195.536123:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.536145:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788305195.536150:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+5:8437:x1875173761378816:12345-0@lo:104: Request processed in 34us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.536154:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305195.536167:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305195.536172:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+4:8437:x1875173761378944:12345-0@lo:104: 00010000:00010000:1.0:1788305195.536179:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.536202:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788305195.536207:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+4:8437:x1875173761378944:12345-0@lo:104: Request processed in 35us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.536212:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305195.536223:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305195.536235:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:8437:x1875173761379072:12345-0@lo:104: 00010000:00010000:1.0:1788305195.536242:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305195.536268:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788305195.536273:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:8437:x1875173761379072:12345-0@lo:104: Request processed in 39us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305195.536278:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788305195.536341:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788305195.536346:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536354:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030a00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.536358:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536366:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.536377:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.536396:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.536428:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536435:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.536450:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536457:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80030a00/0x902a3611c9ae8433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae843a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536469:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788305195.536473:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536478:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.536481:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536487:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.536494:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.536498:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.536514:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536520:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.536525:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536530:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae8409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536538:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788305195.536541:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536547:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.536550:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536556:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.536562:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.536567:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.536576:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536582:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.536653:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536669:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb9071f400/0x902a3611c9ae83ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83f4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536677:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788305195.536680:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536686:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f800 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.536688:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536695:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.536701:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.536707:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.536719:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536724:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.536729:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536735:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb9071f800/0x902a3611c9ae83df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536742:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788305195.536749:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536755:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031a00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.536758:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536764:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.536770:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.536776:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.536787:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536792:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.536796:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536802:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae83d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536810:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305195.536814:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536819:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7de00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.536822:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536943:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.536951:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.536957:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.536969:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536975:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.536979:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536985:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7de00/0x902a3611c9ae83a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83ae expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.536994:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305195.536997:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.537003:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d200 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305195.537006:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.537012:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305195.537018:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305195.537028:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305195.537038:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.537044:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305195.537047:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.537077:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d200/0x902a3611c9ae837d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8384 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.537089:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305195.537091:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305195.537093:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305195.537105:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379328:0@lo:103: 00000100:00100000:3.0:1788305195.537138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305195.537164:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379840:0@lo:103: 00000100:00100000:3.0:1788305195.537181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305195.537196:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788305195.537201:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379200:0@lo:103: 00000100:00100000:3.0:1788305195.537216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305195.537226:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379712:0@lo:103: 00000100:00100000:3.0:1788305195.537240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305195.537274:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378304:0@lo:104: 00000100:00100000:3.0:1788305195.537282:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378432:0@lo:104: 00000100:00100000:3.0:1788305195.537289:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378560:0@lo:104: 00000100:00100000:3.0:1788305195.537301:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378688:0@lo:104: 00000100:00100000:3.0:1788305195.537308:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378816:0@lo:104: 00000100:00100000:3.0:1788305195.537313:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378944:0@lo:104: 00000100:00100000:3.0:1788305195.537319:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761379072:0@lo:104: 00000100:00100000:0.0:1788305195.537406:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761379584:0@lo:103: 00000100:00100000:0.0:1788305195.537432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305195.537444:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788305195.537448:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761379456:0@lo:103: 00000100:00100000:0.0:1788305195.537465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305195.537473:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761379968:0@lo:103: 00000100:00100000:0.0:1788305195.537488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305195.537506:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379328 00000100:00100000:0.0:1788305195.537511:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379328 00010000:00010000:0.0:1788305195.537530:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 19 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537545:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379840 00000100:00100000:0.0:1788305195.537547:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379840 00010000:00010000:0.0:1788305195.537557:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 20 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537566:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379200 00000100:00100000:0.0:1788305195.537573:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379200 00010000:00010000:0.0:1788305195.537584:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537655:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379712 00000100:00100000:0.0:1788305195.537659:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379712 00010000:00010000:0.0:1788305195.537671:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 22 pid: 5826 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537683:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379584 00000100:00100000:0.0:1788305195.537685:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379584 00010000:00010000:0.0:1788305195.537693:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83df expref: 23 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537702:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379456 00000100:00100000:0.0:1788305195.537704:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379456 00010000:00010000:0.0:1788305195.537712:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 24 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537721:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761379968 00000100:00100000:0.0:1788305195.537723:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761379968 00010000:00010000:0.0:1788305195.537731:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae837d expref: 25 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.537742:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305195.537749:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+25:3302:x1875173761379328:12345-0@lo:103: 00010000:00010000:0.0:1788305195.537760:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.537765:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 25 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.537774:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 25 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.537796:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031000/0x902a3611c9ae8410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8409 expref: 25 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.537809:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.537956:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+24:3302:x1875173761379328:12345-0@lo:103: Request processed in 207us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.537964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305195.537977:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305195.537982:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+23:3302:x1875173761379840:12345-0@lo:103: 00010000:00010000:0.0:1788305195.537989:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.537994:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 23 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538002:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 23 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538011:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae83ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae83a7 expref: 23 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538019:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.538039:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+22:3302:x1875173761379840:12345-0@lo:103: Request processed in 57us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.538045:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305195.538084:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305195.538090:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+21:3302:x1875173761379200:12345-0@lo:103: 00010000:00010000:0.0:1788305195.538097:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.538101:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538115:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538125:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae843a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8433 expref: 21 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538133:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.538152:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+20:3302:x1875173761379200:12345-0@lo:103: Request processed in 63us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.538158:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305195.538168:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305195.538174:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761379712:12345-0@lo:103: 00010000:00010000:0.0:1788305195.538180:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.538184:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 19 pid: 5826 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538192:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 19 pid: 5826 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538201:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae83d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae83d1 expref: 19 pid: 5826 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538209:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.538226:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3302:x1875173761379712:12345-0@lo:103: Request processed in 53us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.538232:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305195.538241:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305195.538247:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:3304:x1875173761379584:12345-0@lo:103: 00010000:00010000:0.0:1788305195.538258:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.538262:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83df expref: 17 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538270:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae83df expref: 17 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538279:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031800/0x902a3611c9ae83e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae83df expref: 17 pid: 5828 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538287:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.538311:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3304:x1875173761379584:12345-0@lo:103: Request processed in 64us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.538316:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305195.538327:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305195.538332:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:3304:x1875173761379456:12345-0@lo:103: 00010000:00010000:0.0:1788305195.538339:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.538343:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 15 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538350:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 15 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538360:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae83f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae83ed expref: 15 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538368:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.538400:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:3304:x1875173761379456:12345-0@lo:103: Request processed in 68us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.538406:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305195.538425:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305195.538431:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83073450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+13:3304:x1875173761379968:12345-0@lo:103: 00010000:00010000:0.0:1788305195.538438:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.538442:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae837d expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538450:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae837d expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538459:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81491400/0x902a3611c9ae8384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae837d expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.538468:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.538488:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83073450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+12:3304:x1875173761379968:12345-0@lo:103: Request processed in 57us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.538493:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305195.538538:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761379456:0@lo:103: 00000100:00100000:0.0:1788305195.538546:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761379968:0@lo:103: 00000100:00100000:0.0:1788305195.538552:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761379584:0@lo:103: 00000100:00100000:3.0:1788305195.538691:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379200:0@lo:103: 00000100:00100000:3.0:1788305195.538699:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379712:0@lo:103: 00000100:00100000:3.0:1788305195.538705:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379328:0@lo:103: 00000100:00100000:3.0:1788305195.538711:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761379840:0@lo:103: 00010000:00010000:3.0:1788305195.539139:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305195.546938:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378048:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305195.546957:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875173761378176:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305195.547003:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305195.562460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305195.562558:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305195.562969:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433344 00000100:00100000:0.0:1788305195.562979:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433344 00010000:00010000:0.0:1788305195.563018:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 10 pid: 5826 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.563084:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433472 00000100:00100000:0.0:1788305195.563088:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433472 00010000:00010000:0.0:1788305195.563102:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 11 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305195.563136:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1788305195.563146:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2348:x1875173741433344:12345-192.168.201.38@tcp:103: 00010000:00010000:0.0:1788305195.563160:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.563166:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 11 pid: 5826 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563179:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 11 pid: 5826 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563196:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae844f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2fc expref: 11 pid: 5826 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563211:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.563271:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2348:x1875173741433344:12345-192.168.201.38@tcp:103: Request processed in 127us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.563278:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1788305195.563294:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:0.0:1788305195.563301:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:2348:x1875173741433472:12345-192.168.201.38@tcp:103: 00010000:00010000:0.0:1788305195.563308:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305195.563312:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 9 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563321:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 9 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563330:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a2f5 expref: 9 pid: 5827 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563346:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563353:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563387:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563395:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563402:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563408:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563414:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305195.563418:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563425:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563437:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.563446:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305195.563464:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:2348:x1875173741433472:12345-192.168.201.38@tcp:103: Request processed in 164us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305195.563476:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00010000:00010000:3.0:1788305195.565099:0:8437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.565115:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305195.565121:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490200/0x902a3611c9ae8487 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305195.889707:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788305196.657295:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788305196.657316:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fa818a7800 from 39 10000000:01000000:3.0:1788305196.657324:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305196.657435:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.657450:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.657465:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305196.657498:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380096:0@lo:101: 00000100:00100000:3.0:1788305196.657616:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.657709:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.658009:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380096 00000100:00100000:0.0:1788305196.658020:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380096 00000100:00100000:0.0:1788305196.658119:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788305196.658133:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+12:5830:x1875173761380096:12345-0@lo:101: 00010000:00010000:0.0:1788305196.658151:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305196.658168:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae848e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.658197:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae848e expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.658209:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae848e expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.658220:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031600, rc 0) 00000100:00100000:0.0:1788305196.658279:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761380096:12345-0@lo:101: Request processed in 149us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.658286:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788305196.658660:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380096:0@lo:101: 00010000:00010000:1.0:1788305196.658679:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.658688:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305196.658757:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380224:0@lo:501: 00000100:00100000:1.0:1788305196.658806:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305196.658843:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.659072:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380224 00000100:00100000:0.0:1788305196.659079:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380224 00000100:00100000:0.0:1788305196.659118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788305196.659126:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761380224:12345-0@lo:501: 00000100:00100000:0.0:1788305196.659720:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761380224:12345-0@lo:501: Request processed in 593us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.659730:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788305196.668583:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380224:0@lo:501: 00000100:00100000:2.0:1788305196.668702:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380352:0@lo:503: 00000100:00100000:2.0:1788305196.669022:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.669113:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.670120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380352 00000100:00100000:0.0:1788305196.670148:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380352 00000100:00100000:0.0:1788305196.670224:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788305196.670235:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761380352:12345-0@lo:503: 00000100:00100000:0.0:1788305196.670560:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761380352:12345-0@lo:503: Request processed in 326us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.670569:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788305196.671170:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380352:0@lo:503: 00000100:00100000:3.0:1788305196.672830:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8453:1875173761380480:0@lo:502: 00000100:00100000:3.0:1788305196.672929:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.673045:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305196.675492:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380480 00000100:00100000:1.0:1788305196.675513:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380480 00000100:00100000:1.0:1788305196.675806:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788305196.675821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:8453:x1875173761380480:12345-0@lo:502: 00000100:00100000:1.0:1788305196.676281:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:8453:x1875173761380480:12345-0@lo:502: Request processed in 452us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305196.676296:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788305196.676556:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8453:1875173761380480:0@lo:502: 00000100:00100000:3.0:1788305196.676941:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8453:1875173761380608:0@lo:502: 00000100:00100000:3.0:1788305196.677006:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.694285:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.708029:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380608 00000100:00100000:0.0:1788305196.708051:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380608 00000100:00100000:0.0:1788305196.708162:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788305196.708177:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:8453:x1875173761380608:12345-0@lo:502: 00000100:00100000:0.0:1788305196.709188:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+13:8453:x1875173761380608:12345-0@lo:502: Request processed in 1011us (32177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.709199:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788305196.712997:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8453:1875173761380608:0@lo:502: 00000040:00080000:1.0:1788305196.713106:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788305196.713522:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788305196.713554:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305196.713568:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.713593:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305196.713604:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788305196.713614:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788305196.713618:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788305196.713879:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.713890:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.713901:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305196.713927:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380736:0@lo:101: 00000100:00100000:2.0:1788305196.714043:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.714118:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305196.714559:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380736 00000100:00100000:1.0:1788305196.714568:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380736 00000100:00100000:1.0:1788305196.714654:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788305196.714665:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+13:5830:x1875173761380736:12345-0@lo:101: 00010000:00010000:1.0:1788305196.714684:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305196.714702:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071ea00/0x902a3611c9ae84a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae849c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.714735:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071ea00/0x902a3611c9ae84a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae849c expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.714748:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071ea00/0x902a3611c9ae84a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae849c expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.714759:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ea00, rc 0) 00000100:00100000:1.0:1788305196.714835:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761380736:12345-0@lo:101: Request processed in 171us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305196.714843:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788305196.715268:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380736:0@lo:101: 00010000:00010000:3.0:1788305196.715306:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.715319:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305196.715415:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380864:0@lo:501: 00000100:00100000:3.0:1788305196.715453:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.715499:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305196.715885:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380864 00000100:00100000:1.0:1788305196.715893:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380864 00000100:00100000:1.0:1788305196.715936:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788305196.715945:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761380864:12345-0@lo:501: 00000100:00100000:1.0:1788305196.717244:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761380864:12345-0@lo:501: Request processed in 1293us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305196.717258:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788305196.717466:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380864:0@lo:501: 00000100:00100000:3.0:1788305196.717529:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380992:0@lo:503: 00000100:00100000:3.0:1788305196.717605:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.717890:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761380992 00000100:00100000:0.0:1788305196.717898:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761380992 00000100:00100000:0.0:1788305196.717955:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788305196.717967:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761380992:12345-0@lo:503: 00000100:00100000:0.0:1788305196.718212:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761380992:12345-0@lo:503: Request processed in 246us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.718220:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788305196.719210:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.719240:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761380992:0@lo:503: 00000100:00100000:0.0:1788305196.721648:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8454:1875173761381120:0@lo:502: 00000100:00100000:0.0:1788305196.721774:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.721829:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0492240 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.721989:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381120 00000100:00100000:3.0:1788305196.721999:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381120 00000100:00100000:3.0:1788305196.722088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788305196.722099:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:8454:x1875173761381120:12345-0@lo:502: 00000100:00100000:3.0:1788305196.722376:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+14:8454:x1875173761381120:12345-0@lo:502: Request processed in 277us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.722384:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788305196.723028:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8454:1875173761381120:0@lo:502: 00000020:01000000:1.0:1788305196.723098:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305196.723111:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305196.723114:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305196.723121:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788305196.723158:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8454:1875173761381248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305196.723209:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305196.723235:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.724788:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381248 00000100:00100000:0.0:1788305196.724805:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381248 00000100:00100000:0.0:1788305196.724865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788305196.724876:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:8454:x1875173761381248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.725251:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:8454:x1875173761381248:12345-0@lo:502:llog_process_th.0 Request processed in 375us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.725260:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788305196.727039:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8454:1875173761381248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305196.727160:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305196.727173:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305196.727176:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305196.727182:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788305196.728157:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788305196.728188:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788305196.728205:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.728218:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305196.728231:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788305196.728236:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fbb95e7800 from 39 10000000:01000000:3.0:1788305196.728239:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305196.728292:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.728302:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.728330:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305196.728368:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761381376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.728466:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.728514:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.730905:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381376 00000100:00100000:0.0:1788305196.730926:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381376 00000100:00100000:0.0:1788305196.731012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788305196.731025:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+14:5830:x1875173761381376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305196.731045:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305196.731110:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031800/0x902a3611c9ae84b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.731147:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031800/0x902a3611c9ae84b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae84aa expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.731159:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031800/0x902a3611c9ae84b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae84aa expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.731171:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031800, rc 0) 00000100:00100000:0.0:1788305196.731275:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761381376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.731283:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788305196.731907:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761381376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305196.731933:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.731945:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305196.732042:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761381504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305196.732118:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305196.732155:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.732506:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381504 00000100:00100000:3.0:1788305196.732513:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381504 00000100:00100000:3.0:1788305196.732545:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788305196.732554:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761381504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.732934:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761381504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.732942:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788305196.733538:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761381504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305196.733597:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761381632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305196.733666:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305196.733692:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.734314:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381632 00000100:00100000:0.0:1788305196.734324:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381632 00000100:00100000:0.0:1788305196.734379:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788305196.734390:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761381632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.736352:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761381632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1955us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.736394:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788305196.738945:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761381632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.741469:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8455:1875173761381760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.741589:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.741650:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.743442:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381760 00000100:00100000:0.0:1788305196.743458:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381760 00000100:00100000:0.0:1788305196.743521:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788305196.743533:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:8455:x1875173761381760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.745527:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:8455:x1875173761381760:12345-0@lo:502:llog_process_th.0 Request processed in 1987us (3943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.745543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788305196.749516:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8455:1875173761381760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.756825:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8455:1875173761381888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.756992:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.757152:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305196.757910:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761381888 00000100:00100000:2.0:1788305196.757923:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761381888 00000100:00100000:3.0:1788305196.758350:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788305196.758373:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:8455:x1875173761381888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.759296:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+15:8455:x1875173761381888:12345-0@lo:502:llog_process_th.0 Request processed in 930us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.759308:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788305196.759978:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8455:1875173761381888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788305196.760380:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788305196.760908:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788305196.760938:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305196.760952:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.760966:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305196.760978:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788305196.760982:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788305196.760985:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788305196.761036:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.761044:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.761549:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305196.761904:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.761999:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.762218:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0492900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305196.762386:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382016 00000100:00100000:2.0:1788305196.762396:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382016 00000100:00100000:2.0:1788305196.762569:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788305196.762592:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+15:5830:x1875173761382016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305196.762827:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305196.762851:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7d200/0x902a3611c9ae84bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae84b8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.762884:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7d200/0x902a3611c9ae84bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae84b8 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.762895:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7d200/0x902a3611c9ae84bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae84b8 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.762906:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d200, rc 0) 00000100:00100000:2.0:1788305196.763009:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761382016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 422us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305196.763017:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788305196.763261:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305196.763280:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.763372:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305196.763530:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.763572:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.763884:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0492900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305196.763945:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382144 00000100:00100000:2.0:1788305196.763952:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382144 00000100:00100000:2.0:1788305196.764031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788305196.764041:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761382144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305196.764465:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761382144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 425us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305196.764474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788305196.764798:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.764844:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.764897:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.765446:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0492900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305196.765482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382272 00000100:00100000:1.0:1788305196.765490:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382272 00000100:00100000:1.0:1788305196.765528:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788305196.765537:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761382272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305196.765801:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761382272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305196.765809:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788305196.766250:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.767259:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8456:1875173761382400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.767478:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.767798:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba04929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.767937:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382400 00000100:00100000:3.0:1788305196.767946:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382400 00000100:00100000:3.0:1788305196.767993:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788305196.768004:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:8456:x1875173761382400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.768301:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:8456:x1875173761382400:12345-0@lo:502:llog_process_th.0 Request processed in 286us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.768310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788305196.768482:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8456:1875173761382400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305196.768527:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305196.768541:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305196.768543:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305196.768549:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788305196.768590:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8456:1875173761382528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305196.768752:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305196.768790:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.768951:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382528 00000100:00100000:0.0:1788305196.768956:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382528 00000100:00100000:0.0:1788305196.768996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788305196.769003:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:8456:x1875173761382528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.769179:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:8456:x1875173761382528:12345-0@lo:502:llog_process_th.0 Request processed in 176us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.769187:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788305196.770087:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8456:1875173761382528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305196.770123:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305196.770132:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305196.770135:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305196.770140:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788305196.770821:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788305196.770845:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788305196.770858:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.770871:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305196.770884:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788305196.770887:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fb8951b000 from 39 10000000:01000000:0.0:1788305196.770890:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305196.770929:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.770938:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.770964:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305196.770987:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.771047:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.771118:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba04929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305196.771249:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382656 00000100:00100000:1.0:1788305196.771257:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382656 00000100:00100000:1.0:1788305196.771379:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788305196.771390:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761382656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305196.771501:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305196.771519:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae84cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae84c6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.771548:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae84cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae84c6 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.771561:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae84cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae84c6 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305196.771571:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ec00, rc 0) 00000100:00100000:1.0:1788305196.771903:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761382656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 515us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305196.771922:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788305196.777048:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305196.777250:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.777266:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305196.777884:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.777969:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.778106:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305196.778253:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382784 00000100:00100000:2.0:1788305196.778261:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382784 00000100:00100000:2.0:1788305196.778475:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788305196.778487:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761382784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305196.779175:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761382784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 687us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305196.779185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788305196.779477:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.779534:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.779836:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.779909:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305196.779947:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761382912 00000100:00100000:2.0:1788305196.779955:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761382912 00000100:00100000:2.0:1788305196.779998:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788305196.780008:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761382912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305196.780234:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761382912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305196.780242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788305196.780455:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761382912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.781002:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8457:1875173761383040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.781049:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.781144:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.781195:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383040 00000100:00100000:0.0:1788305196.781202:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383040 00000100:00100000:0.0:1788305196.781243:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788305196.781252:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8457:x1875173761383040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.781497:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8457:x1875173761383040:12345-0@lo:502:llog_process_th.0 Request processed in 246us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.781505:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788305196.781785:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8457:1875173761383040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.781837:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8457:1875173761383168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.781874:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.781899:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.782086:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383168 00000100:00100000:0.0:1788305196.782092:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383168 00000100:00100000:0.0:1788305196.782121:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305196.782129:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8457:x1875173761383168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.782278:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8457:x1875173761383168:12345-0@lo:502:llog_process_th.0 Request processed in 149us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.782299:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788305196.782563:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8457:1875173761383168:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788305196.782598:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788305196.783091:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788305196.783115:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305196.783127:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.783140:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305196.783163:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788305196.783166:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788305196.783169:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788305196.783205:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.783214:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.783224:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305196.783243:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761383296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.783368:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.783415:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba04929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.783819:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383296 00000100:00100000:3.0:1788305196.783826:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383296 00000100:00100000:3.0:1788305196.783866:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788305196.783876:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761383296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305196.783890:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305196.783905:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb81490800/0x902a3611c9ae84db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae84d4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.783934:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81490800/0x902a3611c9ae84db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae84d4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.783945:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb81490800/0x902a3611c9ae84db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae84d4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.783955:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81490800, rc 0) 00000100:00100000:3.0:1788305196.784006:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761383296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.784013:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788305196.784102:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761383296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305196.784117:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305196.784127:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305196.784193:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761383424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305196.784224:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.784258:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.784389:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383424 00000100:00100000:3.0:1788305196.784393:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383424 00000100:00100000:3.0:1788305196.784623:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788305196.784639:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761383424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.784964:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761383424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.784972:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788305196.785128:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761383424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305196.785168:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761383552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305196.785211:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.786121:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.787086:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383552 00000100:00100000:0.0:1788305196.787097:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383552 00000100:00100000:0.0:1788305196.787270:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761384064:0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.787390:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788305196.787398:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761383680:0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787431:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.787450:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761384192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.787502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384064 00000100:00100000:0.0:1788305196.787505:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384064 00000100:00100000:0.0:1788305196.787553:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383680 00000100:00100000:0.0:1788305196.787561:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383680 00000100:00100000:0.0:1788305196.787595:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305196.787605:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761384064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761384064:12345-0@lo:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.787677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305196.787693:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305196.787699:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761383680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787721:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761383680:12345-0@lo:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.787726:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305196.787742:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384192 00000100:00100000:0.0:1788305196.787745:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384192 00000100:00100000:0.0:1788305196.787785:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305196.787792:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761384192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787821:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761384192:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.787827:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788305196.787842:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305196.787847:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305196.787880:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761383680:0@lo:400:kworker.0 00010000:00080000:0.0:1788305196.787893:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb0700 x1875173761384192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305196.787903:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761384192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787910:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761384064:0@lo:400:kworker.0 00000100:00100000:0.0:1788305196.787960:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788305196.788185:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761383552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.788416:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761383552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 448us (3204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.788423:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788305196.788896:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761383552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.789431:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761383808:0@lo:400:kworker.0 00000100:00100000:3.0:1788305196.789480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305196.789518:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305196.789525:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761383936:0@lo:400:kworker.0 00000100:00100000:3.0:1788305196.789552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.789756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383808 00000100:00100000:2.0:1788305196.789774:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383808 00000100:00100000:2.0:1788305196.789821:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305196.789830:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761383808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305196.789878:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761383808:12345-0@lo:400:kworker.0 Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305196.789885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788305196.790115:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305196.790281:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8458:1875173761384320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305196.790335:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.790371:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305196.790486:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384320 00000100:00100000:0.0:1788305196.790491:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384320 00000100:00100000:0.0:1788305196.790513:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788305196.790519:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8458:x1875173761384320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305196.790980:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8458:x1875173761384320:12345-0@lo:502:llog_process_th.0 Request processed in 459us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305196.790988:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788305196.791212:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761383936 00000100:00100000:3.0:1788305196.791218:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761383936 00000100:00100000:3.0:1788305196.791260:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305196.791268:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761383936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305196.791320:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761383936:12345-0@lo:400:kworker.0 Request processed in 53us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.791326:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788305196.791375:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a3480 x1875173761383936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305196.791391:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761383936:0@lo:400:kworker.0 00000100:00100000:3.0:1788305196.791417:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761383808:0@lo:400:kworker.0 00000100:00100000:2.0:1788305196.791616:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8458:1875173761384320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305196.791656:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305196.791668:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305196.791670:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788305196.791677:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788305196.791708:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8458:1875173761384448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305196.791750:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305196.792112:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.792243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384448 00000100:00100000:3.0:1788305196.792249:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384448 00000100:00100000:3.0:1788305196.792276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788305196.792294:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8458:x1875173761384448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305196.792562:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8458:x1875173761384448:12345-0@lo:502:llog_process_th.0 Request processed in 278us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.792570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788305196.793004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305196.793268:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8458:1875173761384448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305196.793322:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305196.793329:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305196.793331:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788305196.793336:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788305196.793839:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788305196.793867:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305196.793881:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.793893:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305196.793906:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788305196.793909:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96fba05219b8 from 1 10000000:01000000:0.0:1788305196.793913:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305196.793951:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.794035:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.794047:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305196.794102:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761384576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.794161:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.794199:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.794268:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384576 00000100:00100000:3.0:1788305196.794275:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384576 00000100:00100000:3.0:1788305196.794325:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788305196.794335:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761384576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305196.794349:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305196.794375:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb81491400/0x902a3611c9ae84e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae84e2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.794412:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81491400/0x902a3611c9ae84e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae84e2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.794424:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb81491400/0x902a3611c9ae84e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae84e2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.794434:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81491400, rc 0) 00000100:00100000:3.0:1788305196.794478:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761384576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305196.794484:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788305196.794896:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761384576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305196.794911:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.794921:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305196.795042:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761384704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305196.795101:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305196.795126:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb410180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305196.795302:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384704 00000100:00100000:3.0:1788305196.795308:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384704 00000100:00100000:3.0:1788305196.795332:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788305196.795339:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761384704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305196.796279:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761384704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 935us (1172us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305196.796309:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788305196.797271:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761384704:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788305196.797336:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788305196.797349:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305196.797372:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305196.914013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305197.298256:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761384832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305197.298382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305197.299131:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384832 00000100:00100000:2.0:1788305197.299144:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384832 00000100:00100000:2.0:1788305197.299224:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305197.299237:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761384832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305197.299296:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305197.299391:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761384832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305197.299401:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788305197.299806:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0599500 x1875173761384832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305197.299832:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761384832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305197.302642:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305197.302673:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761384960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305197.302771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305197.303164:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761384960 00000100:00100000:1.0:1788305197.303175:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761384960 00000100:00100000:1.0:1788305197.303242:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305197.303254:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761384960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305197.303812:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305197.303900:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761384960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 647us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305197.303909:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788305197.304037:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a96d80 x1875173761384960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305197.304106:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761384960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305197.937708:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305198.024188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305198.024404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433600 00000100:00100000:2.0:1788305198.024419:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433600 00000100:00100000:2.0:1788305198.024497:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:2.0:1788305198.024511:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:5590:x1875173741433600:12345-192.168.201.38@tcp:101: 00010000:00010000:2.0:1788305198.024533:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305198.024789:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae84f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a35e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305198.024832:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae84f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a35e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305198.024845:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae84f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a35e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305198.024857:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7de00, rc 0) 00000100:00100000:2.0:1788305198.024936:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741433600:12345-192.168.201.38@tcp:101: Request processed in 427us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305198.024962:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:3.0:1788305198.028290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305198.028507:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433728 00000100:00100000:2.0:1788305198.028521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433728 00000100:00100000:2.0:1788305198.028609:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:2.0:1788305198.028730:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741433728:12345-192.168.201.38@tcp:501: 00000100:00100000:2.0:1788305198.030830:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741433728:12345-192.168.201.38@tcp:501: Request processed in 2197us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305198.030846:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:1.0:1788305198.043933:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305198.044391:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433856 00000100:00100000:0.0:1788305198.044404:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433856 00000100:00100000:0.0:1788305198.044504:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:0.0:1788305198.044516:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741433856:12345-192.168.201.38@tcp:503: 00000100:00100000:0.0:1788305198.044846:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741433856:12345-192.168.201.38@tcp:503: Request processed in 331us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305198.044855:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:1.0:1788305198.054872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305198.055493:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741433984 00000100:00100000:2.0:1788305198.055509:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741433984 00000100:00100000:2.0:1788305198.055590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:2.0:1788305198.055604:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:6070:x1875173741433984:12345-192.168.201.38@tcp:502: 00000100:00100000:2.0:1788305198.056005:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:6070:x1875173741433984:12345-192.168.201.38@tcp:502: Request processed in 403us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305198.056023:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:3.0:1788305198.069896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305198.070345:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434112 00000100:00100000:0.0:1788305198.070360:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434112 00000100:00100000:0.0:1788305198.070499:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:0.0:1788305198.070514:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:6070:x1875173741434112:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305198.072209:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:6070:x1875173741434112:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 1689us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305198.072224:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:3.0:1788305198.088660:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305198.089096:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434240 00000100:00100000:2.0:1788305198.089251:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434240 00000100:00100000:2.0:1788305198.089330:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:2.0:1788305198.089354:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741434240:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305198.089375:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305198.089401:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae84f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a365 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305198.089438:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae84f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a365 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305198.089678:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae84f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a365 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305198.089691:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7da00, rc 0) 00000100:00100000:2.0:1788305198.089779:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741434240:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 428us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305198.089786:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:3.0:1788305198.094579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305198.094763:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434368 00000100:00100000:0.0:1788305198.094777:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434368 00000100:00100000:0.0:1788305198.094878:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:0.0:1788305198.094891:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741434368:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305198.096465:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741434368:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 1566us (1892us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305198.097443:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00010000:00010000:3.0:1788305198.961386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305199.252340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305199.252403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305199.252706:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434496 00000100:00100000:0.0:1788305199.252720:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434496 00000100:00100000:0.0:1788305199.252799:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:0.0:1788305199.252826:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741434496:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305199.252928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741434496:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 118us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305199.252937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:1.0:1788305199.253119:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434752 00000100:00100000:1.0:1788305199.253124:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434752 00000100:00100000:1.0:1788305199.253255:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1788305199.253264:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741434752:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305199.253301:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741434752:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305199.253309:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00080000:0.0:1788305199.253913:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305199.257006:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305199.257124:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305199.257339:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434624 00000100:00100000:0.0:1788305199.257352:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434624 00000100:00100000:0.0:1788305199.257459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:0.0:1788305199.257474:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741434624:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305199.257785:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741434624:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 314us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305199.257795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:1.0:1788305199.257964:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741434880 00000100:00100000:1.0:1788305199.257971:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741434880 00000100:00100000:1.0:1788305199.258026:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1788305199.258035:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741434880:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305199.258326:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741434880:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 282us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305199.258353:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00080000:3.0:1788305199.258767:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305199.258774:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305199.991751:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305200.358541:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc2d881f0 20000000:00000080:1.0:1788305200.358570:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fbba473000 uarg=0000000000000000 20000000:01000000:1.0:1788305200.358622:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788305200.358699:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788305200.358706:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788305200.363779:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788305200.365548:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788305200.376490:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788305200.376711:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788305200.376767:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788305200.376785:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305200.376803:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376820:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376828:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376834:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376843:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376849:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376894:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.376910:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 9 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305200.376923:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385088:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305200.377027:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.377036:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 18 pid: 5826 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305200.377046:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385216:0@lo:104: 00000100:00100000:2.0:1788305200.378048:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305200.378224:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385216 00000100:00100000:1.0:1788305200.378240:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385216 00000100:00100000:1.0:1788305200.378319:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305200.378334:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:8497:x1875173761385216:12345-0@lo:104: 00010000:00010000:1.0:1788305200.378356:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.378376:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.378397:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305200.378412:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385344:0@lo:104: 00000100:00100000:2.0:1788305200.378461:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305200.378466:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305200.378485:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:8497:x1875173761385216:12345-0@lo:104: Request processed in 146us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305200.378494:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788305200.378503:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305200.378522:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.378532:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305200.378544:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.378554:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305200.378561:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305200.378567:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305200.378795:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.378802:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305200.378834:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.378841:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7d000/0x902a3611c9ae8399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae83a0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.378855:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305200.378857:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305200.378859:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305200.378897:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761385472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305200.378932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305200.379346:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.379356:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305200.379378:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385600:0@lo:104: 00000100:00100000:2.0:1788305200.379403:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305200.379424:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385216:0@lo:104: 00000100:00100000:0.0:1788305200.379506:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385472 00000100:00100000:0.0:1788305200.379513:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385472 00010000:00010000:0.0:1788305200.379550:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 19 pid: 5826 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305200.379592:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305200.379603:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761385472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305200.379628:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305200.379641:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 19 pid: 5826 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.379651:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 19 pid: 5826 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.379666:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030200/0x902a3611c9ae83a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8399 expref: 19 pid: 5826 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.379681:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305200.379731:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3303:x1875173761385472:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305200.379738:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788305200.379807:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761385472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305200.384388:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788305200.384439:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305200.384481:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385344 00000100:00100000:1.0:1788305200.384490:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385344 00000100:00100000:1.0:1788305200.384531:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385600 00000100:00100000:1.0:1788305200.384535:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385600 00000100:00100000:1.0:1788305200.384550:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305200.384559:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+4:8497:x1875173761385344:12345-0@lo:104: 00010000:00010000:1.0:1788305200.384590:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305200.384683:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305200.384690:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+4:8497:x1875173761385344:12345-0@lo:104: Request processed in 133us (6229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305200.384697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305200.384739:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305200.384747:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:8497:x1875173761385600:12345-0@lo:104: 00010000:00010000:1.0:1788305200.384755:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305200.384789:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788305200.384794:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+3:8497:x1875173761385600:12345-0@lo:104: Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305200.384800:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305200.385104:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385088:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305200.385127:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385344:0@lo:104: 00000100:00100000:2.0:1788305200.385138:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875173761385600:0@lo:104: 00010000:00010000:2.0:1788305200.385181:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385352:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305200.385361:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385370:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fce00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305200.385374:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385382:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305200.385389:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305200.385394:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305200.385439:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385457:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305200.385475:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385482:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fce00/0x902a3611c9ae82ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae82d5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385499:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305200.385503:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385510:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305200.385514:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385520:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305200.385525:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305200.385530:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305200.385542:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385548:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305200.385565:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385571:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c000/0x902a3611c9ae826c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8273 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305200.385597:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305200.385598:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305200.385614:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305200.385617:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305200.385637:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761385856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305200.385682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305200.385757:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385856 00000100:00100000:0.0:1788305200.385763:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385856 00010000:00010000:0.0:1788305200.385787:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305200.385818:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305200.385829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305200.385836:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3301:x1875173761385856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305200.385848:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305200.385855:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385869:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305200.385871:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788305200.385888:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788305200.385895:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae826c expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.385912:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305200.385954:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:3301:x1875173761385856:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305200.385962:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788305200.385977:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435008 00000100:00100000:0.0:1788305200.385981:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435008 00010000:00010000:0.0:1788305200.386003:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 10 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305200.386018:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1788305200.386024:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2348:x1875173741435008:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305200.386032:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305200.386037:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 10 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.386047:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 10 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.386080:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071e400/0x902a3611c9ae845d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a32d expref: 10 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.386089:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305200.386142:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:2348:x1875173741435008:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 118us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305200.386149:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:3.0:1788305200.386324:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761385728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305200.386375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305200.386882:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761385856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305200.386922:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385728 00000100:00100000:0.0:1788305200.386928:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385728 00010000:00010000:0.0:1788305200.386949:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 17 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305200.386967:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305200.386974:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:3304:x1875173761385728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305200.386983:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305200.386997:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 17 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387007:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 17 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387019:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae82d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae82ce expref: 17 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387034:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387043:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387085:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387093:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387352:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387360:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387367:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305200.387371:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387379:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387401:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305200.387411:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305200.387469:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3304:x1875173761385728:12345-0@lo:103:ldlm_bl.0 Request processed in 495us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305200.387476:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305200.387513:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761385728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305200.388399:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.388419:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305200.388428:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae84fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305201.018703:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305201.423871:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305201.423957:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435136 00000100:00100000:3.0:1788305201.423972:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435136 00000100:00100000:3.0:1788305201.424048:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:3.0:1788305201.424331:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:5590:x1875173741435136:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305201.424355:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305201.424385:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a36c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305201.424421:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305201.424436:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305201.424449:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81490000, rc 0) 00000100:00100000:3.0:1788305201.424526:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741435136:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 201us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305201.424534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:0.0:1788305201.433800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305201.434143:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435264 00000100:00100000:2.0:1788305201.434157:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435264 00000100:00100000:2.0:1788305201.434228:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:2.0:1788305201.434241:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741435264:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305201.434770:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741435264:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 528us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305201.434780:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:1.0:1788305201.438461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305201.438761:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435392 00000100:00100000:3.0:1788305201.438776:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435392 00000100:00100000:3.0:1788305201.438844:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:3.0:1788305201.438857:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741435392:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305201.439419:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:5590:x1875173741435392:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 560us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305201.439430:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:1.0:1788305201.443889:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305201.444315:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435520 00000100:00100000:3.0:1788305201.444329:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435520 00000100:00100000:3.0:1788305201.444416:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:3.0:1788305201.444447:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:6128:x1875173741435520:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305201.444792:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:6128:x1875173741435520:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 346us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305201.444802:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:1.0:1788305201.453605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305201.453851:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435648 00000100:00100000:0.0:1788305201.453865:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435648 00000100:00100000:0.0:1788305201.453968:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:0.0:1788305201.453983:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:6128:x1875173741435648:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305201.454470:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:6128:x1875173741435648:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 488us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305201.454480:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:1.0:1788305201.921655:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761386112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305201.921727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305201.921961:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761385984:0@lo:400:kworker.0 00000100:00100000:0.0:1788305201.921996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305201.922027:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761386240:0@lo:400:kworker.0 00000100:00100000:0.0:1788305201.922074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305201.922105:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386112 00000100:00100000:0.0:1788305201.922113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386112 00000100:00100000:0.0:1788305201.922170:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386240 00000100:00100000:0.0:1788305201.922174:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386240 00000100:00100000:0.0:1788305201.922203:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305201.922213:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305201.922285:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761386112:12345-0@lo:400:kworker.0 Request processed in 72us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305201.922293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305201.922309:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305201.922315:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761386240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305201.922358:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761386240:12345-0@lo:400:kworker.0 Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305201.922364:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305201.922381:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761385984 00000100:00100000:0.0:1788305201.922384:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761385984 00000100:00100000:0.0:1788305201.922408:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788305201.922414:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3302:x1875173761385984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305201.922445:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3302:x1875173761385984:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305201.922451:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788305201.922480:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305201.923450:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761386368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305201.923517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305201.924029:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761385984:0@lo:400:kworker.0 00000100:00100000:2.0:1788305201.924038:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761386496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305201.924088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305201.924161:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761386240:0@lo:400:kworker.0 00000100:00100000:2.0:1788305201.924182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386496 00000100:00100000:2.0:1788305201.924188:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386496 00000100:00100000:2.0:1788305201.924237:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788305201.924247:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761386496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305201.924347:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761386112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305201.924355:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761386624:0@lo:400:kworker.0 00000100:00100000:1.0:1788305201.924383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305201.924422:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386368 00000100:00100000:1.0:1788305201.924434:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386368 00000100:00100000:1.0:1788305201.924461:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386624 00000100:00100000:1.0:1788305201.924464:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386624 00000100:00100000:1.0:1788305201.924481:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305201.924654:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761386368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305201.924691:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761386368:12345-0@lo:400:kworker.0 Request processed in 205us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305201.924699:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305201.924717:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305201.924723:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761386624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305201.924755:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761386624:12345-0@lo:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305201.924761:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788305201.924803:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a97100 x1875173761386624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305201.924815:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761386624:0@lo:400:kworker.0 00000100:00080000:0.0:1788305201.928909:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305201.928920:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305201.928923:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305201.928979:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a95500 x1875173761386368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305201.928997:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761386368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305201.939123:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761386496:12345-0@lo:400:kworker.0 Request processed in 14867us (15023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305201.939257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305201.939810:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761386496:0@lo:400:kworker.0 00010000:00010000:3.0:1788305202.035692:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788305202.355944:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305202.355951:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fa818a7800 from 4 10000000:01000000:1.0:1788305202.355956:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305202.356003:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305202.356014:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305202.356025:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305202.356048:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761386752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305202.356153:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305202.356209:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305202.356274:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386752 00000100:00100000:0.0:1788305202.356282:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386752 00000100:00100000:0.0:1788305202.356335:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788305202.356351:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761386752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305202.356364:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305202.356411:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae850c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305202.356435:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae850c expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305202.356446:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae850c expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305202.356455:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030a00, rc 0) 00000100:00100000:0.0:1788305202.356515:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761386752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305202.356522:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788305202.356708:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761386752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305202.356721:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305202.356729:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305202.356793:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761386880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305202.356817:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305202.356838:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305202.356942:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761386880 00000100:00100000:0.0:1788305202.356947:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761386880 00000100:00100000:0.0:1788305202.356975:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788305202.356982:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761386880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305202.357238:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761386880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305202.357256:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788305202.357292:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761386880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305202.357321:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305202.357358:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305202.357382:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.357524:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387008 00000100:00100000:3.0:1788305202.357529:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387008 00000100:00100000:3.0:1788305202.357565:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788305202.357572:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761387008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.357728:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761387008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.357735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788305202.357772:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.357935:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8570:1875173761387136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305202.357966:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.357985:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305202.361693:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387136 00000100:00100000:0.0:1788305202.361721:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387136 00000100:00100000:0.0:1788305202.361782:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788305202.361792:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8570:x1875173761387136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305202.362026:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8570:x1875173761387136:12345-0@lo:502:llog_process_th.0 Request processed in 234us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305202.362033:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788305202.362345:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8570:1875173761387136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305202.362380:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305202.362390:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305202.362392:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305202.362399:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fa818a7800 00000020:00000080:3.0:1788305202.362402:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788305202.362493:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8570:1875173761387264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305202.362533:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.362565:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305202.365750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387264 00000100:00100000:0.0:1788305202.365763:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387264 00000100:00100000:0.0:1788305202.365817:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788305202.365829:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8570:x1875173761387264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305202.366098:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:8570:x1875173761387264:12345-0@lo:502:llog_process_th.0 Request processed in 270us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305202.366106:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788305202.367628:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8570:1875173761387264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305202.367667:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305202.367675:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305202.367677:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788305202.367682:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788305202.367751:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788305202.367773:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305202.367783:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.367794:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305202.367804:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305202.367807:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb95e7800 from 4 10000000:01000000:3.0:1788305202.367809:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305202.367838:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.367846:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.367855:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305202.367877:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.367929:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.367961:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.367977:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387392 00000100:00100000:3.0:1788305202.367982:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387392 00000100:00100000:3.0:1788305202.368026:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788305202.368035:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761387392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305202.368074:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305202.368086:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae851a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.368108:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae851a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.368118:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae851a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.368127:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81490e00, rc 0) 00000100:00100000:3.0:1788305202.368160:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761387392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.368167:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788305202.368201:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305202.368214:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.368223:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305202.368274:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.368300:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.368313:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.368324:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387520 00000100:00100000:3.0:1788305202.368327:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387520 00000100:00100000:3.0:1788305202.368353:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788305202.368359:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761387520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.369285:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761387520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 923us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.369294:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788305202.369413:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.369463:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.369501:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.369533:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305202.369880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387648 00000100:00100000:1.0:1788305202.369886:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387648 00000100:00100000:1.0:1788305202.369925:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788305202.369934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761387648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305202.372534:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761387648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2593us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305202.372548:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788305202.372630:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761387648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305202.374317:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8574:1875173761387776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305202.374385:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305202.374431:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.374541:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387776 00000100:00100000:3.0:1788305202.374548:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387776 00000100:00100000:3.0:1788305202.374608:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788305202.374618:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8574:x1875173761387776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305202.374796:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8574:x1875173761387776:12345-0@lo:502:llog_process_th.0 Request processed in 179us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.374804:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788305202.375608:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8574:1875173761387776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305202.375642:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305202.375658:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305202.375660:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788305202.375672:0:8574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbb95e7800 00000020:00000080:1.0:1788305202.375675:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788305202.375757:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8574:1875173761387904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305202.375808:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305202.375832:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305202.376972:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761387904 00000100:00100000:2.0:1788305202.376982:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761387904 00000100:00100000:2.0:1788305202.377187:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788305202.377197:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8574:x1875173761387904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305202.377438:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:8574:x1875173761387904:12345-0@lo:502:llog_process_th.0 Request processed in 241us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305202.377445:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788305202.377530:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8574:1875173761387904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305202.377559:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305202.377566:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305202.377568:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788305202.377575:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788305202.385311:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788305202.385346:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305202.385357:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385370:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305202.385382:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305202.385385:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fb8951b000 from 4 10000000:01000000:3.0:1788305202.385388:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305202.385438:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385447:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385473:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305202.385502:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761388032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.385570:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.385629:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.385650:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388032 00000100:00100000:3.0:1788305202.385656:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388032 00000100:00100000:3.0:1788305202.385698:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788305202.385708:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761388032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305202.385721:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305202.385735:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385756:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385766:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385775:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fda00, rc 0) 00000100:00100000:3.0:1788305202.385811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761388032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.385817:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788305202.385867:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761388032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305202.385881:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.385889:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305202.385934:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761388160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.385958:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.385972:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb872b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.385983:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388160 00000100:00100000:3.0:1788305202.385986:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388160 00000100:00100000:3.0:1788305202.386001:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788305202.386006:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761388160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.387399:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761388160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1386us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.387411:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788305202.387473:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761388160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.387514:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761388288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.387551:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.387573:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.387736:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388288 00000100:00100000:3.0:1788305202.387742:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388288 00000100:00100000:3.0:1788305202.387768:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788305202.387776:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761388288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.387914:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761388288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.387927:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788305202.387968:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761388288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305202.388813:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8575:1875173761388416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305202.388865:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305202.388890:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388416 00000100:00100000:3.0:1788305202.388894:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388416 00000100:00100000:3.0:1788305202.388920:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788305202.388927:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:8575:x1875173761388416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305202.389428:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305202.389673:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:8575:x1875173761388416:12345-0@lo:502:llog_process_th.0 Request processed in 653us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305202.389683:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788305202.391781:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8575:1875173761388416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305202.391822:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305202.391832:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305202.391834:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788305202.391841:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fb8951b000 00000020:00000080:2.0:1788305202.391852:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788305202.391953:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8575:1875173761388544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305202.392019:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305202.393142:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388544 00000100:00100000:2.0:1788305202.393152:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388544 00000100:00100000:2.0:1788305202.393201:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788305202.393211:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:8575:x1875173761388544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305202.393440:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:8575:x1875173761388544:12345-0@lo:502:llog_process_th.0 Request processed in 230us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305202.393448:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788305202.393843:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305202.393864:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:8575:1875173761388544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305202.393894:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305202.393902:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305202.393904:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788305202.393909:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788305202.394097:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788305202.394116:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305202.394127:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305202.394139:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305202.417653:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305202.417675:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761388672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305202.417746:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305202.417801:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388672 00000100:00100000:0.0:1788305202.417808:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388672 00000100:00100000:0.0:1788305202.417853:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305202.417863:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761388672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305202.417900:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305202.417943:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761388672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305202.417951:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788305202.417989:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb1500 x1875173761388672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305202.418009:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761388672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305202.425806:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761388800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305202.425880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305202.425993:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388800 00000100:00100000:2.0:1788305202.426001:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388800 00000100:00100000:2.0:1788305202.426077:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305202.426087:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761388800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305202.426123:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305202.426172:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761388800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305202.426180:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788305202.426215:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e73480 x1875173761388800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305202.426235:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761388800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788305203.057461:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305204.088562:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305204.362131:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305204.362173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305204.362197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305204.362241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305204.362280:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435904 00000100:00100000:1.0:1788305204.362291:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435904 00000100:00100000:1.0:1788305204.362367:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1788305204.362378:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741435904:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305204.362467:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741435904:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305204.362476:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1788305204.362502:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436032 00000100:00100000:1.0:1788305204.362505:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436032 00000100:00100000:1.0:1788305204.362534:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436160 00000100:00100000:1.0:1788305204.362536:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436160 00000100:00100000:1.0:1788305204.362551:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305204.362558:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741436032:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305204.362594:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741436032:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 36us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305204.362602:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305204.362613:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788305204.362619:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741436160:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305204.362638:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741436160:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 20us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305204.362645:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00080000:1.0:1788305204.362660:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305204.362665:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305204.362667:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305204.362906:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741435776 00000100:00100000:3.0:1788305204.362911:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741435776 00000100:00100000:3.0:1788305204.362940:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:3.0:1788305204.362947:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741435776:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305204.362979:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741435776:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305204.362992:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 193 00010000:00010000:3.0:1788305205.109204:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305206.132386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305207.025360:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761389312:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.025488:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305207.025493:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761388928:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.025542:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761389440:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.025576:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761389184:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.025602:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305207.025605:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761389056:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.025624:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761389568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.025676:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389312 00000100:00100000:1.0:1788305207.025681:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389312 00000100:00100000:1.0:1788305207.025717:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389568 00000100:00100000:1.0:1788305207.025719:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389568 00000100:00100000:1.0:1788305207.025731:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305207.025738:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761389312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025775:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761389312:12345-0@lo:400:kworker.0 Request processed in 38us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305207.025780:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305207.025792:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305207.025795:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761389568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025812:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761389568:12345-0@lo:400:kworker.0 Request processed in 16us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305207.025815:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305207.025826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389440 00000100:00100000:1.0:1788305207.025829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389440 00000100:00100000:1.0:1788305207.025843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389184 00000100:00100000:1.0:1788305207.025844:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389184 00000100:00100000:1.0:1788305207.025851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389056 00000100:00100000:1.0:1788305207.025852:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389056 00000100:00100000:1.0:1788305207.025860:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305207.025863:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761389440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025880:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761389440:12345-0@lo:400:kworker.0 Request processed in 17us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305207.025884:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305207.025889:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305207.025892:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761389184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761389184:12345-0@lo:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305207.025920:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305207.025927:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305207.025930:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761389056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.025942:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761389056:12345-0@lo:400:kworker.0 Request processed in 12us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305207.025946:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788305207.025959:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305207.025963:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305207.025964:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305207.026126:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761389056:0@lo:400:kworker.0 00010000:00080000:1.0:1788305207.026137:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0598700 x1875173761389568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305207.026147:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761389568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.026155:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761389184:0@lo:400:kworker.0 00000100:00100000:1.0:1788305207.026201:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761389440:0@lo:400:kworker.0 00010000:00080000:1.0:1788305207.026211:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a97b80 x1875173761389312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305207.026219:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761389312:0@lo:400:kworker.0 00000100:00100000:3.0:1788305207.027201:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761388928 00000100:00100000:3.0:1788305207.027212:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761388928 00000100:00100000:3.0:1788305207.027295:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788305207.027305:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761388928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305207.027370:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761388928:12345-0@lo:400:kworker.0 Request processed in 68us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305207.027377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788305207.027434:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761388928:0@lo:400:kworker.0 00000001:02000400:1.0:1788305207.143279:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788305207.153571:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305207.540558:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761389696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305207.540628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305207.540700:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389696 00000100:00100000:0.0:1788305207.540707:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389696 00000100:00100000:0.0:1788305207.540748:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305207.540758:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761389696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305207.540791:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305207.540835:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761389696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305207.540843:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788305207.540880:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb2a00 x1875173761389696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305207.540899:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761389696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305207.541512:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305207.541672:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761389824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305207.541709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305207.541786:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389824 00000100:00100000:1.0:1788305207.541792:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389824 00000100:00100000:1.0:1788305207.541835:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305207.541843:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761389824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305207.541866:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305207.541913:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761389824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305207.541920:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788305207.541989:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e73480 x1875173761389824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305207.542003:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761389824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305208.178590:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305209.201373:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305209.485841:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305209.485896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305209.485979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305209.486017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305209.486042:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436544 00000100:00100000:1.0:1788305209.486073:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436544 00000100:00100000:1.0:1788305209.486138:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436672 00000100:00100000:1.0:1788305209.486150:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436672 00000100:00100000:1.0:1788305209.486171:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1788305209.486181:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2346:x1875173741436544:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1788305209.486218:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae846b 00000100:00080000:1.0:1788305209.486229:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fa82775800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305209.486262:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788305209.486599:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+2:2346:x1875173741436544:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 418us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305209.486607:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1788305209.486622:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788305209.486629:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2346:x1875173741436672:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1788305209.486652:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8472 00000100:00080000:1.0:1788305209.486659:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fa82774000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305209.486690:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788305209.486865:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+2:2346:x1875173741436672:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 235us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305209.486870:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00080000:1.0:1788305209.486890:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305209.486893:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788305209.487036:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305209.487152:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436288 00000100:00100000:3.0:1788305209.487158:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436288 00000100:00100000:3.0:1788305209.487193:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:3.0:1788305209.487201:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741436288:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305209.487236:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741436288:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 37us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305209.487242:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 195 00010000:00010000:1.0:1788305209.494408:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305209.509191:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436416 00000100:00100000:0.0:1788305209.509207:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436416 00000100:00100000:0.0:1788305209.509309:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:0.0:1788305209.509320:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741436416:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305209.509399:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741436416:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 80us (23501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305209.509414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00080000:1.0:1788305209.509817:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788305209.696621:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:0.0:1788305209.696631:0:6702:0:(genops.c:885:class_export_put()) final put ffff96fa82773000/5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:0.0:1788305209.696666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa82773000/5455d24f-893c-4899-b5f9-16679e9a93aa for lustre-OST0000 00000020:00000080:0.0:1788305209.696705:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fa82775800 for lustre-OST0000 00010000:00010000:1.0:1788305210.225553:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305211.250389:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305212.161491:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761390336:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305212.161618:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305212.161625:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761389952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161653:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305212.161675:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761390464:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305212.161724:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761390080:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161746:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305212.161760:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761390592:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305212.161798:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305212.161803:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761390208:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305212.161851:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390336 00000100:00100000:0.0:1788305212.161858:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390336 00000100:00100000:0.0:1788305212.161906:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390592 00000100:00100000:0.0:1788305212.161909:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390592 00000100:00100000:0.0:1788305212.161928:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305212.161936:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761390336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.161995:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761390336:12345-0@lo:400:kworker.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305212.162002:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305212.162018:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788305212.162024:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761390592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162083:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761390592:12345-0@lo:400:kworker.0 Request processed in 60us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305212.162089:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788305212.162118:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761389952 00000100:00100000:0.0:1788305212.162122:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761389952 00000100:00100000:0.0:1788305212.162285:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788305212.162292:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761389952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162378:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761389952:12345-0@lo:400:kworker.0 Request processed in 86us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305212.162384:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788305212.162409:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390464 00000100:00100000:0.0:1788305212.162413:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390464 00000100:00100000:0.0:1788305212.162437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390080 00000100:00100000:0.0:1788305212.162440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390080 00000100:00100000:0.0:1788305212.162449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390208 00000100:00100000:0.0:1788305212.162451:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390208 00000100:00100000:0.0:1788305212.162464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305212.162471:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761390464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162501:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761390464:12345-0@lo:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305212.162506:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305212.162517:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305212.162529:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761390080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162557:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761390080:12345-0@lo:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305212.162562:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305212.162573:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305212.162578:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761390208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761390208:12345-0@lo:400:kworker.0 Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305212.162608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788305212.162631:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305212.162635:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305212.162637:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305212.162687:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761390208:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162699:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761390080:0@lo:400:kworker.0 00010000:00080000:0.0:1788305212.162710:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb2d80 x1875173761390592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305212.162721:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761390592:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162752:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761389952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305212.162763:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761390464:0@lo:400:kworker.0 00010000:00080000:0.0:1788305212.162774:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb2680 x1875173761390336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305212.162783:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761390336:0@lo:400:kworker.0 00000001:02000400:0.0:1788305212.204384:0:9042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing yml_node 00010000:00010000:1.0:1788305212.274232:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305212.659308:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761390720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305212.659385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305212.659567:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390720 00000100:00100000:2.0:1788305212.659575:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390720 00000100:00100000:2.0:1788305212.659640:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305212.659651:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761390720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305212.659687:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305212.659733:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761390720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305212.659740:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788305212.659896:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbaf4a3800 x1875173761390720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305212.659914:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761390720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305212.663406:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761390848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305212.663471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305212.664130:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390848 00000100:00100000:2.0:1788305212.664139:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390848 00000100:00100000:2.0:1788305212.664189:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305212.664199:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761390848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305212.664236:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305212.664547:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761390848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 348us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305212.664555:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788305212.667582:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e72a00 x1875173761390848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305212.667609:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761390848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305213.298589:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305214.259833:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:1.0:1788305214.259846:0:7633:0:(genops.c:885:class_export_put()) final put ffff96fa82772800/5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:3.0:1788305214.259926:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa82772800/5455d24f-893c-4899-b5f9-16679e9a93aa for lustre-OST0001 00000020:00000080:3.0:1788305214.259990:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fa82774000 for lustre-OST0001 00010000:00010000:1.0:1788305214.326873:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305214.613882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305214.613937:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305214.614050:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436800 00000100:00100000:1.0:1788305214.614121:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436800 00000100:00100000:1.0:1788305214.614193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:1.0:1788305214.614206:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741436800:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305214.614308:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741436800:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 104us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305214.614318:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:2.0:1788305214.614447:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741436928 00000100:00100000:2.0:1788305214.614452:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741436928 00000100:00100000:2.0:1788305214.614509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788305214.614517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741436928:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305214.614550:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741436928:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 35us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305214.614556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00080000:0.0:1788305214.614613:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305215.346718:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305216.370679:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305216.402520:0:9235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.44 00000100:00100000:0.0:1788305217.269360:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761391360:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.269474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305217.269552:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305217.269559:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761390976:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.269591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305217.269614:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761391488:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.269638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305217.269665:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761391232:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.269688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305217.269707:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788305217.269712:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761391104:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.269733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305217.269757:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761391616:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.269779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305217.269809:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391360 00000100:00100000:0.0:1788305217.269818:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391360 00000100:00100000:0.0:1788305217.269878:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391616 00000100:00100000:0.0:1788305217.269881:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391616 00000100:00100000:0.0:1788305217.269902:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305217.269908:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391488 00000100:00100000:0.0:1788305217.269911:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761391360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305217.269912:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391488 00000100:00100000:2.0:1788305217.269945:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391232 00000100:00100000:2.0:1788305217.269948:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391232 00000100:00100000:0.0:1788305217.269971:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761391360:12345-0@lo:400:kworker.0 Request processed in 60us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305217.269972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391104 00000100:00100000:2.0:1788305217.269975:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391104 00000100:00100000:2.0:1788305217.269987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305217.269987:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305217.269993:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761391488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.270004:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305217.270023:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761391616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305217.270069:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761391488:12345-0@lo:400:kworker.0 Request processed in 58us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305217.270070:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761391616:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305217.270077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305217.270077:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305217.270091:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788305217.270095:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761390976 00000100:00100000:2.0:1788305217.270097:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.270098:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761390976 00000100:00100000:0.0:1788305217.270124:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788305217.270126:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761391232:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305217.270130:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761390976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305217.270132:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305217.270143:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305217.270148:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761391104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.270157:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761390976:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305217.270164:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788305217.270168:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761391104:12345-0@lo:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305217.270173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788305217.270200:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305217.270206:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305217.270208:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305217.270247:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761391104:0@lo:400:kworker.0 00010000:00080000:0.0:1788305217.270261:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb2300 x1875173761391616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305217.270272:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761391616:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.270281:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761391232:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.270311:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761390976:0@lo:400:kworker.0 00000100:00100000:0.0:1788305217.270321:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761391488:0@lo:400:kworker.0 00010000:00080000:0.0:1788305217.270341:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb2d80 x1875173761391360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305217.270351:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761391360:0@lo:400:kworker.0 00010000:00010000:0.0:1788305217.393765:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305217.779218:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305217.779251:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761391744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305217.779370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305217.779528:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391744 00000100:00100000:1.0:1788305217.779538:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391744 00000100:00100000:1.0:1788305217.779604:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305217.779615:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761391744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305217.779662:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305217.779714:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761391744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305217.779722:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788305217.779773:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1a95500 x1875173761391744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305217.779796:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761391744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305217.791091:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761391872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305217.791201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305217.794478:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761391872 00000100:00100000:1.0:1788305217.794550:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761391872 00000100:00100000:1.0:1788305217.794940:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305217.794983:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761391872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305217.796190:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305217.796324:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761391872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1368us (5119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305217.796334:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788305217.796414:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb415500 x1875173761391872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305217.796440:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761391872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788305218.417442:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305219.443603:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305219.545015:0:9332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.44 00000100:00100000:1.0:1788305219.728126:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305219.728178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305219.728209:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437056 00000100:00100000:1.0:1788305219.728219:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437056 00000100:00100000:1.0:1788305219.728270:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:1.0:1788305219.728281:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2349:x1875173741437056:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305219.728349:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2349:x1875173741437056:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305219.728356:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:3.0:1788305219.729450:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437184 00000100:00100000:3.0:1788305219.729458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437184 00000100:00100000:3.0:1788305219.729532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788305219.729541:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741437184:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305219.729653:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741437184:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 113us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305219.729661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00080000:0.0:1788305219.731307:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305220.467849:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305221.489953:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305222.386009:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761392384:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305222.386174:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305222.386180:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761392000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386205:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305222.386226:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761392512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305222.386278:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761392128:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305222.386313:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761392640:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305222.386347:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305222.386351:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761392256:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305222.386392:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392384 00000100:00100000:1.0:1788305222.386398:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392384 00000100:00100000:1.0:1788305222.386456:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392640 00000100:00100000:1.0:1788305222.386459:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392640 00000100:00100000:1.0:1788305222.386476:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305222.386484:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761392384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386531:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761392384:12345-0@lo:400:kworker.0 Request processed in 48us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305222.386538:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305222.386553:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305222.386559:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761392640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386589:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761392640:12345-0@lo:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305222.386595:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305222.386611:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392000 00000100:00100000:1.0:1788305222.386614:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392000 00000100:00100000:1.0:1788305222.386638:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788305222.386643:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761392000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386672:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761392000:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305222.386687:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788305222.386716:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392512 00000100:00100000:1.0:1788305222.386720:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392512 00000100:00100000:1.0:1788305222.386749:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392128 00000100:00100000:1.0:1788305222.386752:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392128 00000100:00100000:1.0:1788305222.386764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392256 00000100:00100000:1.0:1788305222.386766:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392256 00000100:00100000:1.0:1788305222.386791:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305222.386796:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761392512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386827:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761392512:12345-0@lo:400:kworker.0 Request processed in 31us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305222.386834:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305222.386846:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305222.386851:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761392128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386878:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761392128:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305222.386883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305222.386892:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305222.386898:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761392256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.386930:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761392256:12345-0@lo:400:kworker.0 Request processed in 32us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305222.386936:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788305222.386962:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305222.386966:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305222.386968:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305222.386997:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761392256:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.387016:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761392128:0@lo:400:kworker.0 00010000:00080000:1.0:1788305222.387027:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9e35f80 x1875173761392640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305222.387037:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761392640:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.387085:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761392000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305222.387095:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761392512:0@lo:400:kworker.0 00010000:00080000:1.0:1788305222.387104:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9e34a80 x1875173761392384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305222.387112:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761392384:0@lo:400:kworker.0 00000001:02000400:2.0:1788305222.521097:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.44 00010000:00010000:1.0:1788305222.523501:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305222.900499:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305222.900521:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761392896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305222.900601:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305222.900683:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392896 00000100:00100000:0.0:1788305222.900692:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392896 00000100:00100000:0.0:1788305222.900738:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305222.900747:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761392896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305222.900780:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305222.900822:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761392896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305222.900829:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788305222.900866:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb416a00 x1875173761392896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305222.900883:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761392896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305222.900999:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305222.901011:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761392768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305222.901040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305222.901307:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761392768 00000100:00100000:0.0:1788305222.901312:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761392768 00000100:00100000:0.0:1788305222.901358:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788305222.901366:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761392768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305222.901385:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305222.901426:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761392768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305222.901432:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788305222.901530:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9e34a80 x1875173761392768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305222.901544:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761392768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305223.539859:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788305224.537791:0:9479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 19:27:02 EDT 2026 00010000:00010000:3.0:1788305224.562301:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305224.843320:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305224.843358:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305224.843770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437312 00000100:00100000:0.0:1788305224.843782:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437312 00000100:00100000:0.0:1788305224.843847:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:0.0:1788305224.843858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741437312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305224.843940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741437312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305224.843947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:3.0:1788305224.845533:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437440 00000100:00100000:3.0:1788305224.845544:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437440 00000100:00100000:3.0:1788305224.845674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1788305224.845684:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741437440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305224.845753:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741437440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305224.845760:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00080000:1.0:1788305224.849039:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305225.585546:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305226.617442:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305227.506352:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761393408:0@lo:400:kworker.0 00000100:00100000:3.0:1788305227.506451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305227.506538:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305227.506546:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761393024:0@lo:400:kworker.0 00000100:00100000:3.0:1788305227.506599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305227.506629:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761393280:0@lo:400:kworker.0 00000100:00100000:3.0:1788305227.506635:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761393536:0@lo:400:kworker.0 00000100:00100000:3.0:1788305227.506676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305227.506990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393536 00000100:00100000:1.0:1788305227.507001:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393536 00000100:00100000:1.0:1788305227.507098:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788305227.507109:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761393536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305227.515463:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393408 00000100:00100000:0.0:1788305227.515478:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393408 00000100:00100000:0.0:1788305227.515547:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305227.515559:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761393408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305227.515656:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761393408:12345-0@lo:400:kworker.0 Request processed in 99us (9204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305227.515664:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305227.515689:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393024 00000100:00100000:0.0:1788305227.515693:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393024 00000100:00100000:0.0:1788305227.515718:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788305227.515726:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761393024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305227.515766:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761393024:12345-0@lo:400:kworker.0 Request processed in 42us (9169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305227.515784:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1788305227.515828:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305227.515989:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761393024:0@lo:400:kworker.0 00010000:00080000:3.0:1788305227.516017:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc17b7800 x1875173761393408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305227.516032:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761393408:0@lo:400:kworker.0 00000100:00100000:2.0:1788305227.520451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305227.520525:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788305227.520539:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761393152:0@lo:400:kworker.0 00000100:00100000:2.0:1788305227.520593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305227.520615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761393664:0@lo:400:kworker.0 00000100:00100000:2.0:1788305227.520639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305227.520708:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393280 00000100:00100000:2.0:1788305227.520716:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393280 00000100:00100000:2.0:1788305227.520759:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393152 00000100:00100000:2.0:1788305227.520761:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393152 00000100:00100000:2.0:1788305227.520779:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305227.520788:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761393280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305227.520855:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761393280:12345-0@lo:400:kworker.0 Request processed in 68us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305227.520862:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305227.520879:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305227.520885:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761393152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305227.520910:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761393152:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305227.520916:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305227.520964:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761393152:0@lo:400:kworker.0 00000100:00100000:2.0:1788305227.520975:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761393280:0@lo:400:kworker.0 00000100:00100000:3.0:1788305227.523237:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393664 00000100:00100000:3.0:1788305227.523267:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393664 00000100:00100000:3.0:1788305227.523350:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305227.523363:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761393664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305227.523484:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761393664:12345-0@lo:400:kworker.0 Request processed in 125us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305227.523492:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788305227.524360:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305227.524364:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788305227.525130:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc17b6680 x1875173761393664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305227.525148:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761393664:0@lo:400:kworker.0 00000100:00100000:1.0:1788305227.525529:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761393536:12345-0@lo:400:kworker.0 Request processed in 18420us (18850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305227.525541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788305227.526122:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761393536:0@lo:400:kworker.0 00010000:00010000:1.0:1788305227.633703:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305228.020253:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761393792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305228.020324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305228.020387:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305228.020395:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761393920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305228.020419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305228.020466:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393792 00000100:00100000:2.0:1788305228.020474:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393792 00000100:00100000:2.0:1788305228.020509:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761393920 00000100:00100000:2.0:1788305228.020512:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761393920 00000100:00100000:2.0:1788305228.020529:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305228.020537:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761393792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305228.020572:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305228.020614:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761393792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305228.020622:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305228.020638:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305228.020643:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761393920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305228.020660:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305228.020701:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761393920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305228.020707:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788305228.020739:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e72300 x1875173761393920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305228.020758:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761393920:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788305228.020784:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc17b7800 x1875173761393792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305228.020795:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761393792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788305228.657427:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305229.682236:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305229.971086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305229.971151:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305229.971248:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437568 00000100:00100000:3.0:1788305229.971259:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437568 00000100:00100000:3.0:1788305229.971335:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:3.0:1788305229.971345:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2347:x1875173741437568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305229.971415:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2347:x1875173741437568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305229.971422:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:2.0:1788305229.975693:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437696 00000100:00100000:2.0:1788305229.975709:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437696 00000100:00100000:2.0:1788305229.975797:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1788305229.975809:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741437696:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305229.975900:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741437696:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 93us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305229.975907:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00080000:1.0:1788305229.976405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305230.713896:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305231.731857:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305232.625498:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761394048:0@lo:400:kworker.0 00000100:00100000:2.0:1788305232.625604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305232.625795:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761394432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305232.625837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305232.625915:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394432 00000100:00100000:3.0:1788305232.625925:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394432 00000100:00100000:3.0:1788305232.626012:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305232.626024:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761394432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305232.626114:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761394432:12345-0@lo:400:kworker.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305232.626121:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788305232.626147:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305232.626181:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9e37480 x1875173761394432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305232.626208:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761394432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305232.626316:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394048 00000100:00100000:0.0:1788305232.626320:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394048 00000100:00100000:0.0:1788305232.626367:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788305232.626372:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761394048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305232.628140:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761394304:0@lo:400:kworker.0 00000100:00100000:2.0:1788305232.628225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305232.628267:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305232.628274:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761394176:0@lo:400:kworker.0 00000100:00100000:2.0:1788305232.628301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305232.628505:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305232.628559:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394304 00000100:00100000:1.0:1788305232.628567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394304 00000100:00100000:1.0:1788305232.628622:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394176 00000100:00100000:1.0:1788305232.628625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394176 00000100:00100000:1.0:1788305232.628650:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305232.628660:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761394304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.628720:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761394304:12345-0@lo:400:kworker.0 Request processed in 61us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305232.628728:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305232.628760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305232.628767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761394176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.628791:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761394176:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305232.628801:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305232.628844:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761394176:0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.628853:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761394304:0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.628874:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305232.628879:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761394688:0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.628902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788305232.629847:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305232.629922:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761394048:12345-0@lo:400:kworker.0 Request processed in 3543us (4313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305232.629935:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788305232.630120:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761394048:0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.630243:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394688 00000100:00100000:1.0:1788305232.630250:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394688 00000100:00100000:1.0:1788305232.630299:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305232.630307:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761394688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305232.630390:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761394688:12345-0@lo:400:kworker.0 Request processed in 83us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305232.630397:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788305232.630429:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9e34000 x1875173761394688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305232.630442:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761394688:0@lo:400:kworker.0 00000100:00080000:3.0:1788305232.630603:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305232.631097:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761394560:0@lo:400:kworker.0 00000100:00100000:2.0:1788305232.631149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305232.631338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394560 00000100:00100000:1.0:1788305232.631344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394560 00000100:00100000:1.0:1788305232.631443:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305232.631453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761394560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788305232.631458:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305232.631513:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761394560:12345-0@lo:400:kworker.0 Request processed in 61us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305232.631520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788305232.631582:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761394560:0@lo:400:kworker.0 00010000:00010000:1.0:1788305232.753373:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305233.138359:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305233.138395:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761394816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305233.138497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305233.141391:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394816 00000100:00100000:0.0:1788305233.141416:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394816 00000100:00100000:0.0:1788305233.141521:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305233.141536:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761394816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305233.141602:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305233.141729:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761394816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (3230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305233.141747:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788305233.142134:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb416a00 x1875173761394816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305233.142173:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761394816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305233.144944:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305233.144973:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761394944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305233.145096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305233.145777:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761394944 00000100:00100000:3.0:1788305233.145790:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761394944 00000100:00100000:3.0:1788305233.145858:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305233.145871:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761394944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305233.145919:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305233.146428:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761394944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 557us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305233.146437:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788305233.149023:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e70700 x1875173761394944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305233.149088:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761394944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788305233.779604:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305234.801562:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305235.084495:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305235.090280:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305235.090667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437952 00000100:00100000:0.0:1788305235.090678:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437952 00000100:00100000:0.0:1788305235.090781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1788305235.090794:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741437952:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305235.091678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741437952:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 881us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305235.091689:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00080000:0.0:1788305235.091740:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305235.092084:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741437824 00000100:00100000:2.0:1788305235.092093:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741437824 00000100:00100000:2.0:1788305235.092143:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:2.0:1788305235.092151:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741437824:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305235.092196:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2350:x1875173741437824:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 47us (7712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305235.092209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 205 00010000:00010000:2.0:1788305235.829303:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305236.849529:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305237.749016:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761395456:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305237.749162:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305237.749167:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761395072:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305237.749232:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761395584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305237.749301:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761395200:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305237.749341:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761395712:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305237.749379:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305237.749385:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761395328:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305237.749435:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395456 00000100:00100000:3.0:1788305237.749442:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395456 00000100:00100000:3.0:1788305237.749490:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395712 00000100:00100000:3.0:1788305237.749493:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395712 00000100:00100000:3.0:1788305237.749513:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305237.749521:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761395456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749587:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761395456:12345-0@lo:400:kworker.0 Request processed in 66us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305237.749594:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305237.749611:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305237.749617:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761395712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749652:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761395712:12345-0@lo:400:kworker.0 Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305237.749670:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305237.749689:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395072 00000100:00100000:3.0:1788305237.749692:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395072 00000100:00100000:3.0:1788305237.749717:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788305237.749723:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761395072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749752:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761395072:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305237.749758:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788305237.749783:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395584 00000100:00100000:3.0:1788305237.749786:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395584 00000100:00100000:3.0:1788305237.749811:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395200 00000100:00100000:3.0:1788305237.749814:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395200 00000100:00100000:3.0:1788305237.749823:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395328 00000100:00100000:3.0:1788305237.749825:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395328 00000100:00100000:3.0:1788305237.749840:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305237.749845:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761395584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749872:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761395584:12345-0@lo:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305237.749882:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305237.749893:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788305237.749898:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761395200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749924:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761395200:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305237.749929:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788305237.749939:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305237.749950:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761395328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.749977:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761395328:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305237.749982:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788305237.750006:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305237.750010:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305237.750013:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305237.750048:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761395328:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.750083:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761395200:0@lo:400:kworker.0 00010000:00080000:3.0:1788305237.750095:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc16aed80 x1875173761395712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305237.750105:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761395712:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.750134:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761395072:0@lo:400:kworker.0 00000100:00100000:3.0:1788305237.750143:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761395584:0@lo:400:kworker.0 00010000:00080000:3.0:1788305237.750153:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc17b4000 x1875173761395456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305237.750161:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761395456:0@lo:400:kworker.0 00010000:00010000:2.0:1788305237.873923:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305238.257301:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761395968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305238.257377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305238.257448:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761395840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305238.257474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305238.257561:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395968 00000100:00100000:0.0:1788305238.257570:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395968 00000100:00100000:0.0:1788305238.257607:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761395840 00000100:00100000:0.0:1788305238.257610:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761395840 00000100:00100000:0.0:1788305238.257626:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305238.257635:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761395968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305238.257679:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305238.257736:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761395968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305238.257743:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305238.257760:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305238.257766:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761395840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305238.257787:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305238.257814:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761395840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305238.257820:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788305238.257901:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb417100 x1875173761395968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305238.257940:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761395968:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788305238.257954:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e71f80 x1875173761395840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305238.257965:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761395840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305238.898205:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305239.921305:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305240.202195:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305240.202266:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305240.202503:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438080 00000100:00100000:0.0:1788305240.202517:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438080 00000100:00100000:0.0:1788305240.202601:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:0.0:1788305240.202624:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2349:x1875173741438080:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305240.202758:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2349:x1875173741438080:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 146us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305240.202766:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:2.0:1788305240.203758:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438208 00000100:00100000:2.0:1788305240.203770:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438208 00000100:00100000:2.0:1788305240.203868:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:2.0:1788305240.203880:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741438208:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:3.0:1788305240.203947:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305240.203947:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741438208:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305240.203954:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00010000:00010000:0.0:1788305240.945400:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305241.970376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305242.003013:0:10109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:27:20 (1788305240) === 00000100:00100000:2.0:1788305242.567218:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.567368:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438336 00000100:00100000:3.0:1788305242.567382:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438336 00000100:00100000:3.0:1788305242.567465:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:3.0:1788305242.567478:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:8128:x1875173741438336:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305242.567501:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305242.567527:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a373 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.567585:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a373 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.567599:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a373 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.567611:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd600, rc 0) 00000100:00100000:3.0:1788305242.567691:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8128:x1875173741438336:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 215us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.567699:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:1.0:1788305242.570331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.570772:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438464 00000100:00100000:3.0:1788305242.570785:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438464 00000100:00100000:3.0:1788305242.570871:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:3.0:1788305242.570883:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8128:x1875173741438464:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788305242.571611:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8128:x1875173741438464:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 726us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.571623:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:2.0:1788305242.590121:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305242.590237:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438592 00000100:00100000:1.0:1788305242.590251:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438592 00000100:00100000:1.0:1788305242.590324:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:1.0:1788305242.590337:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8128:x1875173741438592:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788305242.590675:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8128:x1875173741438592:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 339us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305242.590696:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:2.0:1788305242.601165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.601299:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438720 00000100:00100000:3.0:1788305242.601313:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438720 00000100:00100000:3.0:1788305242.601444:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:3.0:1788305242.601456:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8132:x1875173741438720:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305242.601832:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8132:x1875173741438720:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 377us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.601841:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:3.0:1788305242.619918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305242.620121:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438848 00000100:00100000:2.0:1788305242.620136:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438848 00000100:00100000:2.0:1788305242.620210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:2.0:1788305242.620224:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8132:x1875173741438848:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305242.620630:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8132:x1875173741438848:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 407us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305242.620640:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:2.0:1788305242.628307:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.628415:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741438976 00000100:00100000:3.0:1788305242.628434:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741438976 00000100:00100000:3.0:1788305242.628500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:3.0:1788305242.628512:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:8128:x1875173741438976:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305242.628533:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305242.628555:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fce00/0x902a3611c9ae853d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a39d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.628598:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fce00/0x902a3611c9ae853d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a39d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.628610:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fce00/0x902a3611c9ae853d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a39d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.628634:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fce00, rc 0) 00000100:00100000:3.0:1788305242.628714:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:8128:x1875173741438976:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 204us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.628722:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:3.0:1788305242.631327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305242.631504:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439104 00000100:00100000:1.0:1788305242.631517:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439104 00000100:00100000:1.0:1788305242.631593:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:1.0:1788305242.631605:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:8128:x1875173741439104:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788305242.631636:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788305242.631668:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788305242.631674:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788305242.631677:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788305242.631679:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788305242.633579:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:8128:x1875173741439104:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 1954us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305242.633596:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:2.0:1788305242.638464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.638640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439232 00000100:00100000:3.0:1788305242.638653:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439232 00000100:00100000:3.0:1788305242.638711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:3.0:1788305242.638723:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:8128:x1875173741439232:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305242.638744:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305242.638767:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3a4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.638812:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.638824:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305242.638835:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd200, rc 0) 00000100:00100000:3.0:1788305242.638908:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8128:x1875173741439232:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 186us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.638914:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:3.0:1788305242.643384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305242.643522:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439360 00000100:00100000:0.0:1788305242.643535:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439360 00000100:00100000:0.0:1788305242.643614:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:0.0:1788305242.643629:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8128:x1875173741439360:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788305242.644100:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8128:x1875173741439360:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 428us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305242.644110:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:1.0:1788305242.647387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305242.647601:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439488 00000100:00100000:0.0:1788305242.647615:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439488 00000100:00100000:0.0:1788305242.647684:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:0.0:1788305242.647695:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8128:x1875173741439488:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788305242.651419:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8128:x1875173741439488:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 357us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305242.651454:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:2.0:1788305242.657728:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.657981:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439616 00000100:00100000:3.0:1788305242.657995:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439616 00000100:00100000:3.0:1788305242.658118:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:3.0:1788305242.658131:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8136:x1875173741439616:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305242.658459:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8136:x1875173741439616:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 328us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.658467:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:3.0:1788305242.662219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305242.662341:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439744 00000100:00100000:0.0:1788305242.662355:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439744 00000100:00100000:0.0:1788305242.662441:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:0.0:1788305242.662454:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8136:x1875173741439744:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305242.662811:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:8136:x1875173741439744:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 359us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305242.662821:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:1.0:1788305242.671099:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305242.671150:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.671405:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741439872 00000100:00100000:3.0:1788305242.671420:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741439872 00000100:00100000:3.0:1788305242.671474:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440256 00000100:00100000:3.0:1788305242.671476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440256 00000100:00100000:3.0:1788305242.671541:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788305242.671554:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741440256:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305242.671659:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741440256:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 108us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.671666:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788305242.671685:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1788305242.671689:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875173741439872:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788305242.671716:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ebaa8433-1f27-44cd-ad51-1be099f60f8e@192.168.201.38@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1788305242.671762:0:5832:0:(genops.c:1385:class_connect()) connect: client ebaa8433-1f27-44cd-ad51-1be099f60f8e, cookie 0x902a3611c9ae854b 00000004:00100000:3.0:1788305242.671801:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788305242.672152:0:5832:0:(import.c:65:import_set_state_nolock()) ffff96fbc0fdf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305242.672189:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2346:x1875173741439872:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 497us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.672197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00080000:1.0:1788305242.672381:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305242.679130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.679321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440000 00000100:00100000:3.0:1788305242.679341:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440000 00000100:00100000:1.0:1788305242.679405:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00080000:2.0:1788305242.679593:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305242.689747:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440128 00000100:00100000:3.0:1788305242.689769:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440128 00000100:00100000:2.0:1788305242.694427:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305242.694465:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+7:0:x1875173741440000:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788305242.694532:0:8201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788305242.694688:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+7:0:x1875173741440000:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 243us (15572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305242.694697:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305242.694787:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788305242.694793:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:8128:x1875173741440128:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788305242.694807:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788305242.694831:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:8128:x1875173741440128:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 38us (15426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305242.694838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788305242.702878:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.703001:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440384 00000100:00100000:3.0:1788305242.703015:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440384 00000100:00100000:3.0:1788305242.703147:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1788305242.703160:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:8128:x1875173741440384:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788305242.703283:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:8128:x1875173741440384:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 126us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.703300:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1788305242.718125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.718183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.718223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.718263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.718300:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305242.718341:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440896 00000100:00100000:3.0:1788305242.718353:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440896 00000100:00100000:1.0:1788305242.718539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440768 00000100:00100000:1.0:1788305242.718544:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440768 00000100:00100000:1.0:1788305242.718594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1788305242.718606:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:8128:x1875173741440768:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788305242.718967:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788305242.719167:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:8128:x1875173741440768:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 561us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305242.719178:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1788305242.719218:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441024 00000100:00100000:1.0:1788305242.719224:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441024 00000100:00100000:1.0:1788305242.719256:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1788305242.719264:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741441024:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305242.719308:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741441024:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 45us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305242.719316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1788305242.719599:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440512 00000100:00100000:2.0:1788305242.719604:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440512 00000100:00100000:2.0:1788305242.719638:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741440640 00000100:00100000:2.0:1788305242.719641:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741440640 00000100:00100000:2.0:1788305242.719655:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788305242.719662:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875173741440512:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788305242.719692:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ebaa8433-1f27-44cd-ad51-1be099f60f8e@192.168.201.38@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:2.0:1788305242.719731:0:6678:0:(genops.c:1385:class_connect()) connect: client ebaa8433-1f27-44cd-ad51-1be099f60f8e, cookie 0x902a3611c9ae8552 00002000:00100000:2.0:1788305242.719745:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ebaa8433-1f27-44cd-ad51-1be099f60f8e/ffff96fbaf4f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305242.719774:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788305242.720080:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:3.0:1788305242.720097:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741440896:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305242.720138:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741440896:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 46us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305242.720145:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 220 00002000:00080000:2.0:1788305242.720683:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788305242.720737:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fa818a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305242.720777:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2346:x1875173741440512:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 1114us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305242.720847:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788305242.720874:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1788305242.720880:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875173741440640:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788305242.720902:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ebaa8433-1f27-44cd-ad51-1be099f60f8e@192.168.201.38@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:2.0:1788305242.720927:0:6678:0:(genops.c:1385:class_connect()) connect: client ebaa8433-1f27-44cd-ad51-1be099f60f8e, cookie 0x902a3611c9ae8559 00002000:00100000:2.0:1788305242.720938:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ebaa8433-1f27-44cd-ad51-1be099f60f8e/ffff96fa818a1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305242.721527:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305242.721757:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305242.722604:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fa81b46800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305242.722684:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2346:x1875173741440640:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 1799us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305242.722694:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1788305242.865682:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761396480:0@lo:400:kworker.0 00000100:00100000:3.0:1788305242.865781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305242.865884:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761396224:0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.865923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305242.866012:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761396736:0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.866087:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396224 00000100:00100000:1.0:1788305242.866107:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396224 00000100:00100000:1.0:1788305242.866175:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788305242.866187:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761396224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.866256:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761396224:12345-0@lo:400:kworker.0 Request processed in 71us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305242.866265:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305242.866526:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305242.866534:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761396352:0@lo:400:kworker.0 00000100:00100000:3.0:1788305242.866580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305242.868237:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396480 00000100:00100000:1.0:1788305242.868252:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396480 00000100:00100000:1.0:1788305242.868322:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305242.868333:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761396480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.868555:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761396480:12345-0@lo:400:kworker.0 Request processed in 223us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305242.868564:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788305242.868603:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305242.868617:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396352 00000100:00100000:1.0:1788305242.868622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396352 00000100:00100000:1.0:1788305242.868656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788305242.868663:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761396352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.868701:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761396352:12345-0@lo:400:kworker.0 Request processed in 39us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305242.868723:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788305242.868740:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305242.868754:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305242.868836:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761396224:0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.868858:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788305242.868869:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761396096:0@lo:400:kworker.0 00000100:00100000:1.0:1788305242.868909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305242.868932:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761396608:0@lo:400:kworker.0 00000100:00100000:0.0:1788305242.869140:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396736 00000100:00100000:0.0:1788305242.869146:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396736 00000100:00100000:0.0:1788305242.869176:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305242.869184:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761396736:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788305242.872020:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305242.872051:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396096 00000100:00100000:2.0:1788305242.872081:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396096 00000100:00100000:2.0:1788305242.872157:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788305242.872169:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761396096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305242.872831:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761396736:12345-0@lo:400:kworker.0 Request processed in 3643us (4071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305242.872843:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305242.883381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788305242.883502:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb85167480 x1875173761396736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305242.883522:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761396736:0@lo:400:kworker.0 00000100:00100000:0.0:1788305242.884157:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396608 00000100:00100000:0.0:1788305242.884167:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396608 00000100:00100000:0.0:1788305242.884277:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788305242.884288:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761396608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305242.884392:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761396608:12345-0@lo:400:kworker.0 Request processed in 105us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305242.884400:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788305242.885343:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305242.885401:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761396608:0@lo:400:kworker.0 00000100:00100000:2.0:1788305242.887760:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761396096:12345-0@lo:400:kworker.0 Request processed in 15579us (18835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305242.887778:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788305242.888335:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761396096:0@lo:400:kworker.0 00000100:00100000:3.0:1788305242.897786:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761396352:0@lo:400:kworker.0 00010000:00080000:3.0:1788305242.897820:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb85164e00 x1875173761396480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305242.897833:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761396480:0@lo:400:kworker.0 00010000:00010000:0.0:1788305242.993411:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305243.377696:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761396864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305243.377804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305243.378107:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396864 00000100:00100000:3.0:1788305243.378118:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396864 00000100:00100000:3.0:1788305243.378185:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305243.378208:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761396864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305243.378237:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305243.385512:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761396992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305243.385636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305243.390951:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788305243.390978:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788305243.391797:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761396992 00000100:00100000:0.0:1788305243.391812:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761396992 00000100:00100000:2.0:1788305243.392120:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305243.392142:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761396992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305243.392175:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305243.392304:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761396992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (6667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305243.392313:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788305243.392507:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e71180 x1875173761396992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305243.392533:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761396992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305243.393403:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761396864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15193us (15593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305243.393425:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788305243.397372:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb417800 x1875173761396864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305243.397853:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761396864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788305244.017340:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788305244.424808:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000001:00100000:1.0:1788305244.967748:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ebaa8433-1f27-44cd-ad51-1be099f60f8e 00010000:00010000:0.0:1788305245.041336:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305245.549082:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ebaa8433-1f27-44cd-ad51-1be099f60f8e 00010000:00010000:2.0:1788305246.081199:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305247.089424:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305247.884920:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305247.885031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305247.885086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305247.885107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305247.885272:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441536 00000100:00100000:1.0:1788305247.885289:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441536 00000100:00100000:1.0:1788305247.885376:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:1.0:1788305247.885387:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741441536:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305247.885458:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741441536:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 72us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305247.885465:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00080000:1.0:1788305247.885501:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305247.886941:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441152 00000100:00100000:1.0:1788305247.886951:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441152 00000100:00100000:1.0:1788305247.886996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:1.0:1788305247.887011:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741441152:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305247.887079:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741441152:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 74us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305247.887087:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:3.0:1788305247.890539:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305247.890575:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441664 00000100:00100000:3.0:1788305247.890585:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441664 00000100:00100000:3.0:1788305247.890663:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1788305247.890674:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741441664:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305247.890923:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741441664:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 249us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305247.890931:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00080000:3.0:1788305247.891037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305247.891262:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441280 00000100:00100000:2.0:1788305247.891268:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441280 00000100:00100000:2.0:1788305247.891305:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441408 00000100:00100000:2.0:1788305247.891309:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441408 00000100:00100000:2.0:1788305247.891337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:2.0:1788305247.891345:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741441280:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305247.891386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741441280:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 41us (6475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305247.891393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:2.0:1788305247.891407:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:2.0:1788305247.891414:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741441408:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305247.891440:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741441408:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305247.891446:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00080000:3.0:1788305247.892294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305247.987641:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761397120:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.987717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305247.987788:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761397632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305247.987816:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397120 00000100:00100000:0.0:1788305247.987817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305247.987824:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397120 00000100:00100000:0.0:1788305247.987839:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305247.987845:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788305247.987868:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788305247.987868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305247.987877:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761397120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.987884:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761397760:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.987905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305247.987925:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761397120:12345-0@lo:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305247.987931:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788305247.987934:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761397120:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.987959:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761397504:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.987982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305247.988010:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305247.988015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761397376:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.988042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305247.988088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397632 00000100:00100000:0.0:1788305247.988092:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397632 00000100:00100000:3.0:1788305247.988097:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397760 00000100:00100000:3.0:1788305247.988100:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397760 00000100:00100000:3.0:1788305247.988125:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397504 00000100:00100000:0.0:1788305247.988125:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397248 00000100:00100000:3.0:1788305247.988127:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397504 00000100:00100000:0.0:1788305247.988127:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397248 00000100:00100000:0.0:1788305247.988138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397376 00000100:00100000:0.0:1788305247.988140:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397376 00000100:00100000:3.0:1788305247.988141:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305247.988147:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761397760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.988152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788305247.988157:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761397632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305247.988185:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761397760:12345-0@lo:400:kworker.0 Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305247.988185:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761397632:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305247.988191:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305247.988198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305247.988203:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305247.988208:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761397504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.988209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305247.988213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761397248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.988236:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761397248:12345-0@lo:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305247.988237:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761397504:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305247.988241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305247.988242:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305247.988252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305247.988258:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761397376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.988286:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761397376:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00080000:1.0:1788305247.989175:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305247.989181:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305247.989184:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305247.989813:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305247.989882:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761397376:0@lo:400:kworker.0 00010000:00080000:0.0:1788305247.989900:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aa9880 x1875173761397504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305247.989912:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761397504:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.989946:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761397248:0@lo:400:kworker.0 00010000:00080000:0.0:1788305247.989957:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aa8380 x1875173761397760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305247.989966:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761397760:0@lo:400:kworker.0 00000100:00100000:0.0:1788305247.989976:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761397632:0@lo:400:kworker.0 00010000:00010000:2.0:1788305248.115782:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305248.497777:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305248.497849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305248.497923:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761397888 00000100:00100000:2.0:1788305248.497931:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761397888 00000100:00100000:2.0:1788305248.497984:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788305248.497994:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761397888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305248.498027:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305248.498090:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761397888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305248.498098:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788305248.498139:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e71180 x1875173761397888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305248.498158:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305248.501772:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305248.501795:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761398016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305248.501862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305248.503172:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398016 00000100:00100000:2.0:1788305248.503183:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398016 00000100:00100000:2.0:1788305248.503243:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305248.503254:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761398016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305248.503292:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305248.503364:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761398016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305248.503372:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788305248.503416:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e71180 x1875173761398016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305248.503439:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761398016:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788305248.508783:0:10307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788305249.137423:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305250.163887:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305251.189674:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305252.214105:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305253.004438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305253.004495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305253.004538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305253.004565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305253.004595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305253.004633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442048 00000100:00100000:1.0:1788305253.004645:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442048 00000100:00100000:1.0:1788305253.004723:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441920 00000100:00100000:1.0:1788305253.004726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441920 00000100:00100000:1.0:1788305253.004775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:1.0:1788305253.004786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741442048:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305253.004887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741442048:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 99us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305253.004895:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:1.0:1788305253.004917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:1.0:1788305253.004923:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741441920:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305253.004949:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741441920:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305253.004955:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:1.0:1788305253.004977:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442304 00000100:00100000:1.0:1788305253.004980:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442304 00000100:00100000:1.0:1788305253.005008:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442176 00000100:00100000:1.0:1788305253.005010:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442176 00000100:00100000:1.0:1788305253.005023:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:1.0:1788305253.005029:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc105cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741442304:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305253.005099:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc105cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741442304:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 70us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305253.005105:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:2.0:1788305253.005429:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741441792 00000100:00100000:2.0:1788305253.005435:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741441792 00000100:00100000:2.0:1788305253.005487:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:2.0:1788305253.005495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741441792:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305253.005538:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741441792:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 44us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305253.005545:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:0.0:1788305253.005943:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1788305253.005960:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741442176:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305253.006015:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741442176:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 59us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305253.006022:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00080000:0.0:1788305253.006083:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305253.006088:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305253.006091:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305253.105738:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761398400:0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.105840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305253.105912:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305253.105918:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761398528:0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.105944:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305253.105986:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398400 00000100:00100000:0.0:1788305253.105995:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398400 00000100:00100000:0.0:1788305253.106089:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305253.106100:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761398400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.106159:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761398400:12345-0@lo:400:kworker.0 Request processed in 60us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305253.106166:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305253.106195:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398528 00000100:00100000:0.0:1788305253.106199:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398528 00000100:00100000:0.0:1788305253.106228:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305253.106236:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761398528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.106271:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761398528:12345-0@lo:400:kworker.0 Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305253.106296:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788305253.106314:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305253.106319:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305253.106357:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb416d80 x1875173761398528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305253.106375:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761398528:0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.106388:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761398400:0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.106614:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.106652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305253.106682:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761398784:0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.106707:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305253.106735:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788305253.106741:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761398144:0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.106783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305253.106808:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761398656:0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.106830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305253.106857:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398784 00000100:00100000:3.0:1788305253.106862:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398784 00000100:00100000:3.0:1788305253.106894:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305253.106900:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761398784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.106938:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761398784:12345-0@lo:400:kworker.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305253.106944:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305253.106964:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398144 00000100:00100000:3.0:1788305253.106967:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398144 00000100:00100000:3.0:1788305253.106992:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788305253.106999:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761398144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305253.107028:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761398144:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305253.107034:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788305253.107112:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761398144:0@lo:400:kworker.0 00010000:00080000:3.0:1788305253.107125:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb417800 x1875173761398784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305253.107136:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761398784:0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.107804:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398272 00000100:00100000:0.0:1788305253.107822:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398272 00000100:00100000:0.0:1788305253.107873:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398656 00000100:00100000:0.0:1788305253.107877:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398656 00000100:00100000:0.0:1788305253.107913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788305253.107921:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761398272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.107985:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761398272:12345-0@lo:400:kworker.0 Request processed in 65us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305253.107993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788305253.108007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305253.108013:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761398656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.108040:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761398656:12345-0@lo:400:kworker.0 Request processed in 28us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305253.108045:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788305253.108310:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305253.108314:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305253.108350:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761398656:0@lo:400:kworker.0 00000100:00100000:0.0:1788305253.108363:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761398272:0@lo:400:kworker.0 00010000:00010000:0.0:1788305253.233381:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305253.617474:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305253.617732:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305253.617748:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761399040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305253.617844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305253.617986:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399040 00000100:00100000:1.0:1788305253.617998:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399040 00000100:00100000:1.0:1788305253.618085:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305253.618097:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761399040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305253.618147:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305253.618230:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761399040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305253.618248:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788305253.618370:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761398912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305253.618418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305253.618670:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761398912 00000100:00100000:0.0:1788305253.618676:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761398912 00000100:00100000:0.0:1788305253.618715:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305253.618723:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761398912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305253.618747:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305253.618785:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761398912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305253.618792:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788305253.618844:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb85167800 x1875173761399040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305253.618869:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761399040:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788305253.620392:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e71180 x1875173761398912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305253.620432:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761398912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788305254.263285:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305255.282446:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305256.307262:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305257.329398:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305258.121107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305258.121163:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305258.121194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305258.121222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305258.121263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305258.121300:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442944 00000100:00100000:3.0:1788305258.121323:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442944 00000100:00100000:3.0:1788305258.121390:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442816 00000100:00100000:3.0:1788305258.121393:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442816 00000100:00100000:3.0:1788305258.121413:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788305258.121425:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741442944:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305258.121514:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741442944:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305258.121534:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788305258.121552:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788305258.121557:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741442816:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305258.121580:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741442816:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305258.121585:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788305258.121617:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442688 00000100:00100000:3.0:1788305258.121621:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442688 00000100:00100000:3.0:1788305258.121649:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442560 00000100:00100000:3.0:1788305258.121652:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442560 00000100:00100000:3.0:1788305258.121672:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1788305258.121678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741442688:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305258.121708:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741442688:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305258.121715:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1788305258.121726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:3.0:1788305258.121732:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741442560:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305258.121763:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741442560:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305258.121769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00080000:3.0:1788305258.121789:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305258.121794:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305258.121796:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305258.122001:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741442432 00000100:00100000:2.0:1788305258.122007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741442432 00000100:00100000:2.0:1788305258.122048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:2.0:1788305258.122075:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741442432:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305258.122117:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741442432:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305258.122125:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:0.0:1788305258.227388:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761399296:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.227487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305258.227565:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761399808:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.227605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305258.227644:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788305258.227650:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761399168:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.227683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305258.227708:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761399680:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.227734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305258.227786:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761399424:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.227815:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305258.227852:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305258.227859:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761399552:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.227882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305258.227915:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399296 00000100:00100000:0.0:1788305258.227925:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399296 00000100:00100000:0.0:1788305258.227977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399680 00000100:00100000:0.0:1788305258.227981:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399680 00000100:00100000:0.0:1788305258.228011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399424 00000100:00100000:0.0:1788305258.228014:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399424 00000100:00100000:0.0:1788305258.228034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788305258.228045:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761399296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228133:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761399296:12345-0@lo:400:kworker.0 Request processed in 89us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.228142:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788305258.228162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305258.228169:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761399680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228198:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761399680:12345-0@lo:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.228204:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305258.228216:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788305258.228222:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761399424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228253:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761399424:12345-0@lo:400:kworker.0 Request processed in 31us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.228259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788305258.228280:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399808 00000100:00100000:0.0:1788305258.228291:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399808 00000100:00100000:0.0:1788305258.228335:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399552 00000100:00100000:0.0:1788305258.228339:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399552 00000100:00100000:0.0:1788305258.228356:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305258.228362:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761399808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228395:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761399808:12345-0@lo:400:kworker.0 Request processed in 33us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.228402:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305258.228413:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305258.228418:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761399552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228445:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761399552:12345-0@lo:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.228451:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305258.228470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399168 00000100:00100000:0.0:1788305258.228474:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399168 00000100:00100000:0.0:1788305258.228502:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788305258.228509:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761399168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228540:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761399168:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.228546:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1788305258.228592:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305258.228597:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305258.228600:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305258.228638:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb415500 x1875173761399552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305258.228657:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761399552:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228670:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761399424:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228712:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761399168:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228722:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761399680:0@lo:400:kworker.0 00000100:00100000:0.0:1788305258.228730:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761399296:0@lo:400:kworker.0 00010000:00080000:0.0:1788305258.228739:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb414700 x1875173761399808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305258.228746:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761399808:0@lo:400:kworker.0 00010000:00010000:3.0:1788305258.357671:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305258.737482:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761399936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305258.737585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305258.737741:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761399936 00000100:00100000:2.0:1788305258.737760:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761399936 00000100:00100000:2.0:1788305258.737828:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788305258.737840:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761399936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305258.737892:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305258.737959:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761399936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305258.737988:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788305258.738039:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e71180 x1875173761399936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305258.738506:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761399936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305258.738534:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305258.738541:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761400064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305258.738578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305258.738670:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400064 00000100:00100000:1.0:1788305258.738677:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400064 00000100:00100000:1.0:1788305258.741462:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305258.741490:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761400064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305258.741547:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1788305258.747437:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb85164a80 x1875173761400064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305258.747473:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761400064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305258.748037:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761400064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5563us (8459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305258.748636:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1788305259.378230:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305260.408872:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305261.428312:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305262.451899:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305263.242130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305263.242165:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305263.242375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305263.242409:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305263.242439:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305263.244328:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443456 00000100:00100000:3.0:1788305263.244350:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443456 00000100:00100000:1.0:1788305263.244610:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443328 00000100:00100000:1.0:1788305263.244615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443328 00000100:00100000:1.0:1788305263.244654:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443200 00000100:00100000:1.0:1788305263.244657:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443200 00000100:00100000:1.0:1788305263.244692:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:1.0:1788305263.244704:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741443328:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305263.244820:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741443328:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 119us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305263.244829:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:1.0:1788305263.244849:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:1.0:1788305263.244855:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741443200:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305263.244881:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741443200:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305263.244898:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:3.0:1788305263.244991:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443584 00000100:00100000:3.0:1788305263.244996:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443584 00000100:00100000:3.0:1788305263.245021:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788305263.245031:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2346:x1875173741443456:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:3.0:1788305263.245085:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8552 00000100:00080000:3.0:1788305263.245097:0:6677:0:(import.c:65:import_set_state_nolock()) ffff96fa818a1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305263.245159:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788305263.245291:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305263.245905:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+2:2346:x1875173741443456:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 871us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305263.245915:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788305263.245936:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788305263.245945:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2346:x1875173741443584:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:3.0:1788305263.245963:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8559 00000100:00080000:3.0:1788305263.245971:0:6677:0:(import.c:65:import_set_state_nolock()) ffff96fa81b46800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305263.246007:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788305263.246554:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305263.247476:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+2:2346:x1875173741443584:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 1523us (5299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305263.247499:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788305263.247547:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443072 00000100:00100000:3.0:1788305263.247558:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443072 00000100:00100000:3.0:1788305263.247615:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:3.0:1788305263.247626:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741443072:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305263.247665:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741443072:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 41us (5291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305263.247671:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00080000:3.0:1788305263.247703:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305263.247710:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305263.247713:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305263.345697:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761400192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.345813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305263.345883:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761400704:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.345917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305263.345951:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305263.345957:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761400320:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.345991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305263.346010:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761400832:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305263.346087:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761400448:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305263.346137:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305263.346143:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761400576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305263.346330:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400192 00000100:00100000:0.0:1788305263.346340:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400192 00000100:00100000:0.0:1788305263.346401:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788305263.346413:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761400192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346497:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761400192:12345-0@lo:400:kworker.0 Request processed in 85us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305263.346504:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788305263.346544:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400704 00000100:00100000:0.0:1788305263.346549:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400704 00000100:00100000:0.0:1788305263.346586:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400320 00000100:00100000:0.0:1788305263.346588:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400320 00000100:00100000:0.0:1788305263.346601:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400448 00000100:00100000:0.0:1788305263.346604:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400448 00000100:00100000:0.0:1788305263.346619:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788305263.346626:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761400704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346660:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761400704:12345-0@lo:400:kworker.0 Request processed in 35us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305263.346666:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788305263.346676:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305263.346689:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761400320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346716:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761400320:12345-0@lo:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305263.346721:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305263.346732:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305263.346737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761400448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346764:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761400448:12345-0@lo:400:kworker.0 Request processed in 27us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305263.346769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305263.346790:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400832 00000100:00100000:0.0:1788305263.346793:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400832 00000100:00100000:0.0:1788305263.346818:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400576 00000100:00100000:0.0:1788305263.346821:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400576 00000100:00100000:0.0:1788305263.346836:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305263.346842:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761400832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346874:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761400832:12345-0@lo:400:kworker.0 Request processed in 32us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305263.346880:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305263.346891:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305263.346900:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761400576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.346927:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761400576:12345-0@lo:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305263.346932:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788305263.346961:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305263.346965:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305263.346968:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305263.347007:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb415500 x1875173761400576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305263.347031:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761400576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.347046:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761400448:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.347105:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761400320:0@lo:400:kworker.0 00010000:00080000:0.0:1788305263.347116:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb0380 x1875173761400832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305263.347125:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761400832:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.347135:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761400192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305263.347145:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761400704:0@lo:400:kworker.0 00010000:00010000:1.0:1788305263.474274:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305263.869692:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761401088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305263.869791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305263.869876:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761400960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305263.874422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305263.879468:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401088 00000100:00100000:3.0:1788305263.879490:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401088 00000100:00100000:3.0:1788305263.879595:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761400960 00000100:00100000:3.0:1788305263.879599:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761400960 00000100:00100000:3.0:1788305263.879626:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305263.879640:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761401088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305263.879693:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305263.879807:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761401088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (10015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305263.879815:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305263.879835:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305263.879842:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761400960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305263.879862:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305263.879899:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761400960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (5490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305263.879934:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788305263.880271:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aa9500 x1875173761401088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305263.880307:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761401088:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788305263.880564:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88eb3b80 x1875173761400960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305263.880585:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761400960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788305264.497308:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305265.463194:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000020:00000080:1.0:1788305265.463208:0:7633:0:(genops.c:885:class_export_put()) final put ffff96fa818a1000/ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000020:00000080:1.0:1788305265.463251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa818a1000/ebaa8433-1f27-44cd-ad51-1be099f60f8e for lustre-OST0001 00000020:00000080:1.0:1788305265.463318:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fa81b46800 for lustre-OST0001 00010000:00010000:0.0:1788305265.522303:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305265.974850:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000020:00000080:1.0:1788305265.974864:0:6702:0:(genops.c:885:class_export_put()) final put ffff96fbaf4f4800/ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000020:00000080:0.0:1788305265.974930:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf4f4800/ebaa8433-1f27-44cd-ad51-1be099f60f8e for lustre-OST0000 00000020:00000080:0.0:1788305265.975000:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fa818a1800 for lustre-OST0000 00010000:00010000:0.0:1788305266.559359:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305266.974572:0:11010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788305267.570465:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305268.362650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305268.362696:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305268.362725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443712 00000100:00100000:2.0:1788305268.362736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305268.362736:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443712 00000100:00100000:2.0:1788305268.362769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443968 00000100:00100000:2.0:1788305268.362774:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443968 00000100:00100000:0.0:1788305268.362796:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:0.0:1788305268.362810:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741443712:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305268.362821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741443840 00000100:00100000:2.0:1788305268.362825:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741443840 00000100:00100000:2.0:1788305268.362852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:2.0:1788305268.362861:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741443968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305268.362885:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741443712:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305268.362893:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:2.0:1788305268.362900:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741443968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305268.362910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:2.0:1788305268.362926:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:2.0:1788305268.362934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741443840:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305268.362960:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741443840:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305268.362974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00080000:2.0:1788305268.362994:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305268.466228:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761401600:0@lo:400:kworker.0 00000100:00100000:1.0:1788305268.466298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305268.466378:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305268.466385:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761401472:0@lo:400:kworker.0 00000100:00100000:1.0:1788305268.466412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305268.466804:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761401216:0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.466842:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305268.467187:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761401728:0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467214:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305268.467239:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305268.467245:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761401344:0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305268.467282:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761401856:0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305268.467329:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401600 00000100:00100000:0.0:1788305268.467336:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401600 00000100:00100000:0.0:1788305268.467398:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401856 00000100:00100000:0.0:1788305268.467401:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401856 00000100:00100000:0.0:1788305268.467418:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305268.467430:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761401600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467485:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761401600:12345-0@lo:400:kworker.0 Request processed in 59us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305268.467491:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305268.467508:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305268.467515:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761401856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467544:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761401856:12345-0@lo:400:kworker.0 Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305268.467563:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305268.467582:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401472 00000100:00100000:0.0:1788305268.467586:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401472 00000100:00100000:0.0:1788305268.467610:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401728 00000100:00100000:0.0:1788305268.467613:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401728 00000100:00100000:0.0:1788305268.467833:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401344 00000100:00100000:0.0:1788305268.467836:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401344 00000100:00100000:0.0:1788305268.467849:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305268.467854:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761401472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467887:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761401472:12345-0@lo:400:kworker.0 Request processed in 32us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305268.467893:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305268.467904:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305268.467911:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761401728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.467935:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761401728:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305268.467942:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305268.467952:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305268.467959:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761401344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.468000:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761401344:12345-0@lo:400:kworker.0 Request processed in 43us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305268.468006:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788305268.468174:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305268.468179:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305268.468181:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305268.468218:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761401472:0@lo:400:kworker.0 00010000:00080000:0.0:1788305268.468235:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb85165500 x1875173761401600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305268.468247:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761401600:0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.468285:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761401344:0@lo:400:kworker.0 00010000:00080000:0.0:1788305268.468305:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb85167b80 x1875173761401856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305268.468313:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761401856:0@lo:400:kworker.0 00000100:00100000:0.0:1788305268.468321:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761401728:0@lo:400:kworker.0 00000100:00100000:1.0:1788305268.470395:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401216 00000100:00100000:1.0:1788305268.470410:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401216 00000100:00100000:1.0:1788305268.470474:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788305268.470484:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761401216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305268.470584:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761401216:12345-0@lo:400:kworker.0 Request processed in 102us (3741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305268.470606:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788305268.471436:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761401216:0@lo:400:kworker.0 00010000:00010000:0.0:1788305268.597997:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305268.978537:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761401984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305268.978650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305268.978817:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761401984 00000100:00100000:1.0:1788305268.978826:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761401984 00000100:00100000:1.0:1788305268.979519:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788305268.979545:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761401984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305268.979588:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305268.979663:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761401984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305268.979671:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305268.983037:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761402112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305268.983135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788305268.983559:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb5d4ad80 x1875173761401984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305268.983582:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761401984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305268.984131:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761402112 00000100:00100000:2.0:1788305268.984140:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761402112 00000100:00100000:2.0:1788305268.984184:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305268.984194:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761402112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305268.984229:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305268.984290:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761402112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305268.984298:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788305268.986327:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbbb414380 x1875173761402112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305268.986426:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761402112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788305269.617260:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788305270.045460:0:11157:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe87abe320 20000000:00000080:0.0:1788305270.045482:0:11157:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fbc0db5c00 uarg=0000000000000000 20000000:01000000:0.0:1788305270.045640:0:11157:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788305270.045647:0:11157:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788305270.045653:0:11157:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788305270.047411:0:11158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788305270.047709:0:11157:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788305270.060017:0:11157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788305270.062523:0:11157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064033:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064050:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae850c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064071:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae851a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064078:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064084:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064093:0:11157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064172:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064191:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 12 pid: 5826 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.064207:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402240:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305270.064510:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.064519:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 18 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.064530:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402368:0@lo:104: 00000100:00100000:1.0:1788305270.064585:0:11157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305270.066097:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761402368 00000100:00100000:2.0:1788305270.066123:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761402368 00000100:00100000:2.0:1788305270.066187:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305270.066199:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:11157:x1875173761402368:12345-0@lo:104: 00010000:00010000:2.0:1788305270.066218:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.066303:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305270.066310:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:11157:x1875173761402368:12345-0@lo:104: Request processed in 114us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305270.066328:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788305270.067546:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305270.067644:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.067655:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81491a00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305270.067659:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.067692:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305270.067700:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305270.067706:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305270.067772:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.067778:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305270.067808:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.067815:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81491a00/0x902a3611c9ae8528 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae852f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.067829:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305270.067831:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305270.067833:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305270.067870:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761402496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305270.067939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305270.071561:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae851a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.071582:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae851a expref: 18 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.071598:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402624:0@lo:104: 00000100:00100000:1.0:1788305270.071664:0:11157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305270.071710:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae850c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.071718:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae850c expref: 18 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.071745:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402752:0@lo:104: 00000100:00100000:1.0:1788305270.071769:0:11157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305270.071813:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.071822:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.071832:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402880:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305270.071878:0:11157:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb8941e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305270.071907:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402368:0@lo:104: 00000100:00100000:1.0:1788305270.071963:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761402496 00000100:00100000:1.0:1788305270.071970:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761402496 00010000:00010000:1.0:1788305270.072003:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 19 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.072036:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305270.072046:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83073050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761402496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305270.072087:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305270.072094:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 19 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.072116:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 19 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.072133:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fda00/0x902a3611c9ae852f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8528 expref: 19 pid: 5827 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305270.072159:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305270.072194:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83073050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3301:x1875173761402496:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305270.072202:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305270.072606:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761402624 00000100:00100000:2.0:1788305270.072611:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761402624 00000100:00100000:2.0:1788305270.072645:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761402752 00000100:00100000:2.0:1788305270.072648:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761402752 00000100:00100000:2.0:1788305270.072658:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305270.072665:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+4:11157:x1875173761402624:12345-0@lo:104: 00010000:00010000:2.0:1788305270.072677:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.072731:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305270.072736:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+4:11157:x1875173761402624:12345-0@lo:104: Request processed in 73us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305270.072742:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305270.072754:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305270.072760:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:11157:x1875173761402752:12345-0@lo:104: 00010000:00010000:2.0:1788305270.072766:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.072796:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305270.072801:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:11157:x1875173761402752:12345-0@lo:104: Request processed in 41us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305270.072806:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305270.073079:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402624:0@lo:104: 00000100:00100000:1.0:1788305270.073090:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402752:0@lo:104: 00010000:00010000:2.0:1788305270.073412:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305270.073419:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073426:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490c00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305270.073431:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073439:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305270.073453:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305270.073459:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305270.073498:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073504:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305270.073524:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073531:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81490c00/0x902a3611c9ae851a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8521 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073542:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305270.073545:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073560:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305270.073563:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073569:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305270.073575:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305270.073580:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305270.073600:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073607:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305270.073623:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073629:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb9071f000/0x902a3611c9ae850c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8513 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.073643:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305270.073645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305270.073647:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305270.073735:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761403136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305270.073783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305270.074824:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761403008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305270.074873:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305270.075432:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403136 00000100:00100000:3.0:1788305270.075444:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403136 00010000:00010000:3.0:1788305270.075485:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae850c expref: 18 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305270.075519:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403008 00000100:00100000:3.0:1788305270.075522:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403008 00010000:00010000:3.0:1788305270.075534:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae851a expref: 19 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305270.075798:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305270.075808:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761403136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305270.075823:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305270.075829:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae850c expref: 19 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.075839:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae850c expref: 19 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.075871:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8513 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae850c expref: 19 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.075889:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305270.075946:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3303:x1875173761403136:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305270.075954:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305270.075971:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305270.075977:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:3302:x1875173761403008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305270.075985:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305270.075990:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae851a expref: 17 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.075999:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae851a expref: 17 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.076009:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490e00/0x902a3611c9ae8521 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae851a expref: 17 pid: 5826 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.076018:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305270.076048:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3302:x1875173761403008:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305270.076085:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305270.076179:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305270.076224:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761403008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305270.076265:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761403136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305270.076282:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444096 00000100:00100000:3.0:1788305270.076293:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444096 00010000:00010000:3.0:1788305270.076312:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 13 pid: 5826 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305270.076453:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb5d4a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402240:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305270.077132:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305270.078583:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1788305270.078606:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741444096:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305270.078626:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305270.078635:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 13 pid: 5826 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.078648:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 13 pid: 5826 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.078665:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8544 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3a4 expref: 13 pid: 5826 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305270.078681:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305270.078755:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:2348:x1875173741444096:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 161us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305270.078764:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788305270.079514:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761402496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305270.079755:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875173761402880:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305270.079787:0:11157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305270.083210:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305270.083340:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444224 00000100:00100000:0.0:1788305270.083350:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444224 00010000:00010000:0.0:1788305270.083396:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305270.083440:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788305270.083465:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:2347:x1875173741444224:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305270.083481:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305270.083487:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083500:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083518:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490000/0x902a3611c9ae8505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a36c expref: 12 pid: 5828 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083536:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083546:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083561:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083569:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083575:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083581:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083588:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305270.083592:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083607:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083624:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.083637:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305270.083684:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2347:x1875173741444224:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 221us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305270.083692:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00010000:00010000:0.0:1788305270.084302:0:11157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.084325:0:11157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305270.084331:0:11157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071e800/0x902a3611c9ae8560 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305270.641252:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788305271.287159:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305271.287169:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fa818a7800 from 7 10000000:01000000:3.0:1788305271.287177:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305271.287244:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.287259:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.287293:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305271.287683:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.287777:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305271.287887:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa8264dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.296823:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403264 00000100:00100000:0.0:1788305271.296843:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403264 00000100:00100000:1.0:1788305271.298198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788305271.298213:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761403264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305271.298232:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305271.298254:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae8567 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.298284:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.298296:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.298325:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fc00, rc 0) 00000100:00100000:1.0:1788305271.298411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761403264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (10633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305271.298417:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788305271.298549:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305271.298581:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.298594:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305271.298759:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305271.298797:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305271.298857:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403392 00000100:00100000:2.0:1788305271.298858:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.298869:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403392 00000100:00100000:0.0:1788305271.298942:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788305271.298953:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761403392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.299404:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761403392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 451us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.299415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788305271.299473:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.299525:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.299576:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305271.299606:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90f38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.299618:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403520 00000100:00100000:0.0:1788305271.299622:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403520 00000100:00100000:0.0:1788305271.299642:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788305271.299649:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761403520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.299812:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761403520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.299820:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788305271.299892:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.309968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305271.310619:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444352 00000100:00100000:1.0:1788305271.310634:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444352 00000100:00100000:1.0:1788305271.311360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 235 00000100:00100000:1.0:1788305271.311376:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:5590:x1875173741444352:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305271.311395:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305271.311413:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3ce expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.311444:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.311456:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.311466:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ee00, rc 0) 00000100:00100000:1.0:1788305271.311904:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741444352:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 531us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305271.311912:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 235 00000040:00080000:2.0:1788305271.314230:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788305271.314924:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788305271.314952:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305271.314969:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305271.314983:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305271.314996:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305271.314999:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb95e7800 from 7 10000000:01000000:2.0:1788305271.315003:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305271.315407:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305271.315438:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305271.315453:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305271.315487:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305271.315578:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305271.319703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305271.319855:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.327150:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403648 00000100:00100000:0.0:1788305271.327168:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403648 00000100:00100000:0.0:1788305271.327247:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788305271.327259:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761403648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305271.327276:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305271.327295:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae857c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305271.327324:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae857c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305271.327334:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae857c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305271.327342:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030a00, rc 0) 00000100:00100000:0.0:1788305271.327432:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761403648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (11853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.327452:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788305271.329251:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305271.329278:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305271.329289:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305271.329372:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.329425:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305271.329466:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90f38780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.329490:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403776 00000100:00100000:0.0:1788305271.333120:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403776 00000100:00100000:0.0:1788305271.333369:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788305271.333381:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761403776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.334661:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761403776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1275us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.334673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788305271.334851:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb415500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305271.334918:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305271.334978:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305271.335020:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb8941e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.335452:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761403904 00000100:00100000:0.0:1788305271.335461:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761403904 00000100:00100000:0.0:1788305271.335507:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788305271.335517:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761403904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.335682:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761403904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.335690:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788305271.335782:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761403904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.339340:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444480 00000100:00100000:0.0:1788305271.339353:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444480 00000100:00100000:0.0:1788305271.339417:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:0.0:1788305271.339429:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741444480:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.339726:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741444480:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 298us (20039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.339734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 239 00000040:00080000:3.0:1788305271.344993:0:11179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788305271.345238:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788305271.345279:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305271.345294:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345307:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305271.345320:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305271.345324:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fb8951b000 from 7 10000000:01000000:3.0:1788305271.345327:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305271.345379:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345399:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345414:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305271.345449:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761404032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.345466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305271.345520:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444608 00000100:00100000:3.0:1788305271.345530:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305271.345532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444608 00000100:00100000:0.0:1788305271.345588:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404032 00000100:00100000:0.0:1788305271.345592:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404032 00000100:00100000:3.0:1788305271.345595:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa8264df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305271.345622:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:3.0:1788305271.345643:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788305271.345645:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741444608:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.345660:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761404032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305271.345677:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305271.345694:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345721:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae858a expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345733:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae858a expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345744:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd200, rc 0) 00000100:00100000:3.0:1788305271.345804:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761404032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305271.345812:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788305271.345882:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761404032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305271.345901:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305271.345920:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305271.345936:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741444608:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 298us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305271.345947:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:3.0:1788305271.345988:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761404160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.346027:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305271.346047:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa8264df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305271.346118:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404160 00000100:00100000:3.0:1788305271.346125:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404160 00000100:00100000:3.0:1788305271.346157:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788305271.346164:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761404160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.346443:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761404160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305271.346450:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788305271.346487:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761404160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.346517:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761404288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.346559:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305271.346657:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa8264df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305271.346670:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404288 00000100:00100000:3.0:1788305271.346673:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404288 00000100:00100000:3.0:1788305271.346692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788305271.346698:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761404288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.346840:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761404288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305271.346848:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788305271.346900:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761404288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305271.359754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000040:00080000:3.0:1788305271.359832:0:11180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:1.0:1788305271.360395:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444736 00000100:00100000:1.0:1788305271.360408:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444736 00000100:00100000:1.0:1788305271.360477:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 244 00000100:00100000:1.0:1788305271.360488:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741444736:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305271.360570:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305271.360591:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3d5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.360623:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.360634:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305271.360643:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f200, rc 0) 00000100:00100000:1.0:1788305271.360758:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741444736:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 270us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305271.360765:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 244 00000020:01000000:2.0:1788305271.365585:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788305271.365639:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305271.365655:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305271.365669:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305271.386678:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305271.386754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444864 00000100:00100000:2.0:1788305271.386768:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444864 00000100:00100000:2.0:1788305271.386857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 245 00000100:00100000:2.0:1788305271.386872:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741444864:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305271.387360:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741444864:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 489us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305271.387371:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 245 00000100:00100000:0.0:1788305271.395857:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305271.395948:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741444992 00000100:00100000:3.0:1788305271.395958:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741444992 00000100:00100000:3.0:1788305271.396015:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 246 00000100:00100000:3.0:1788305271.396026:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741444992:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305271.396371:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88febc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741444992:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 345us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305271.396381:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 246 00010000:00010000:1.0:1788305271.669546:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305272.690876:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305273.484968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305273.485024:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305273.485082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305273.485200:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741445120 00000100:00100000:2.0:1788305273.485211:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741445120 00000100:00100000:2.0:1788305273.485276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 247 00000100:00100000:2.0:1788305273.485300:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741445120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305273.485665:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741445120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 367us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305273.485674:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 247 00000100:00100000:2.0:1788305273.485732:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741445376 00000100:00100000:2.0:1788305273.485737:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741445376 00000100:00100000:2.0:1788305273.485771:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741445248 00000100:00100000:2.0:1788305273.485775:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741445248 00000100:00100000:2.0:1788305273.485796:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1788305273.485803:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741445376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305273.485836:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2348:x1875173741445376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305273.485843:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1788305273.485856:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:2.0:1788305273.485862:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741445248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305273.485945:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741445248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305273.485955:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00080000:2.0:1788305273.485993:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305273.585401:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761404800:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305273.585530:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788305273.585535:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761404416:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305273.585581:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761404928:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305273.585625:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761404672:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585666:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305273.585685:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788305273.585690:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761404544:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305273.585721:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761405056:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585741:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305273.585766:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404416 00000100:00100000:3.0:1788305273.585781:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404416 00000100:00100000:3.0:1788305273.585828:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788305273.585838:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761404416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.585888:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761404416:12345-0@lo:400:kworker.0 Request processed in 50us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305273.585895:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788305273.585927:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404928 00000100:00100000:3.0:1788305273.585932:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404928 00000100:00100000:3.0:1788305273.585964:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404672 00000100:00100000:3.0:1788305273.585967:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404672 00000100:00100000:3.0:1788305273.585980:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404544 00000100:00100000:3.0:1788305273.585983:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404544 00000100:00100000:3.0:1788305273.585995:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788305273.586001:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761404928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.586034:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761404928:12345-0@lo:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305273.586071:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788305273.586085:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788305273.586091:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761404672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.586478:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761404672:12345-0@lo:400:kworker.0 Request processed in 387us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305273.586485:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788305273.586498:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788305273.586504:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761404544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.586530:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761404544:12345-0@lo:400:kworker.0 Request processed in 27us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305273.586536:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788305273.586573:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305273.586607:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761404544:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.586617:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761404672:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.586646:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761404416:0@lo:400:kworker.0 00000100:00100000:3.0:1788305273.586656:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761404928:0@lo:400:kworker.0 00000100:00100000:0.0:1788305273.586757:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761404800 00000100:00100000:0.0:1788305273.586763:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761404800 00000100:00100000:0.0:1788305273.586808:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405056 00000100:00100000:0.0:1788305273.586811:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405056 00000100:00100000:0.0:1788305273.586827:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788305273.586841:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761404800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305273.586888:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761404800:12345-0@lo:400:kworker.0 Request processed in 49us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305273.586895:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788305273.586909:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788305273.586916:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761405056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305273.586947:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761405056:12345-0@lo:400:kworker.0 Request processed in 32us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305273.586954:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788305273.586987:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aaa300 x1875173761405056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305273.586999:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761405056:0@lo:400:kworker.0 00010000:00080000:0.0:1788305273.587023:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aaad80 x1875173761404800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305273.587032:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761404800:0@lo:400:kworker.0 00000100:00080000:3.0:1788305273.587344:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305273.587348:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788305273.713296:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305274.101270:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305274.101293:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761405184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305274.101376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305274.101443:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405184 00000100:00100000:2.0:1788305274.101450:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405184 00000100:00100000:2.0:1788305274.101498:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305274.101510:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761405184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305274.101560:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305274.101604:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761405184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305274.101611:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788305274.101650:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9f6f480 x1875173761405184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305274.101668:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761405184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305274.106728:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761405312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305274.106800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305274.106901:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405312 00000100:00100000:3.0:1788305274.106909:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405312 00000100:00100000:3.0:1788305274.106965:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305274.106975:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761405312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305274.107012:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305274.110432:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761405312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3450us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305274.110446:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788305274.110561:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9f6f480 x1875173761405312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305274.110585:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761405312:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788305274.323214:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788305274.737853:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305275.762261:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305276.785369:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788305277.533616:0:11455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:27:55 (1788305275) === 00010000:00010000:3.0:1788305277.811141:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305277.838787:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305277.838836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305277.838905:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741445504 00000100:00100000:3.0:1788305277.838915:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741445504 00000100:00100000:3.0:1788305277.839009:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788305277.839021:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741445504:12345-192.168.201.38@tcp:41:mkdir.0 00000004:00000024:3.0:1788305277.839094:0:8201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788305277.839180:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741445504:12345-192.168.201.38@tcp:41:mkdir.0 Request processed in 161us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305277.839198:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00080000:0.0:1788305277.839528:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305277.839727:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741445632 00000100:00100000:2.0:1788305277.839733:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741445632 00000100:00100000:2.0:1788305277.839773:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:2.0:1788305277.839781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:9677:x1875173741445632:12345-192.168.201.38@tcp:700:mkdir.0 00000100:00100000:2.0:1788305277.839837:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:9677:x1875173741445632:12345-192.168.201.38@tcp:700:mkdir.0 Request processed in 57us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305277.839845:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1788305277.849502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305277.849593:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741445888 00000100:00100000:3.0:1788305277.849610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741445888 00000100:00100000:3.0:1788305277.849705:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788305277.849718:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:9677:x1875173741445888:12345-192.168.201.38@tcp:36:mkdir.0 00010000:00010000:3.0:1788305277.849798:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305277.849850:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae8480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a357 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.849881:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992a00) 00010000:00010000:3.0:1788305277.849895:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305277.850723:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.850744:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.850757:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.850807:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.850815:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.850832:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305277.859732:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788305277.859754:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.859767:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.859775:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.859781:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305277.859787:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.859794:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.859811:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992d00) 00010000:00010000:2.0:1788305277.859813:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305277.859818:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.859824:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae859f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305277.859845:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea2c8f02 reply state 000000004e0e6371 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305277.859874:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305277.859994:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9677:x1875173741445888:12345-192.168.201.38@tcp:36:mkdir.0 Request processed in 10274us (10497us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788305277.860004:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00010000:00010000:2.0:1788305277.869363:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.869382:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.869390:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.869397:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305277.869402:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.869410:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.869428:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96fb88992e00) 00010000:00010000:2.0:1788305277.869431:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305277.869436:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.869442:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85a6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305277.893299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305277.895375:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741446016 00000100:00100000:3.0:1788305277.895397:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741446016 00000100:00100000:3.0:1788305277.895524:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788305277.895543:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:9682:x1875173741446016:12345-192.168.201.38@tcp:101:chmod.0 00010000:00010000:3.0:1788305277.895573:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305277.895605:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae85ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3dc expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.895696:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae85b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.895712:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.895725:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305277.895805:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788305277.895810:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305277.895889:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae85b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.895924:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae85ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3dc expref: 8 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.895948:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae85b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3dc expref: 7 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305277.895958:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:3.0:1788305277.895961:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305277.895977:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd800, rc 0) 00000100:00100000:3.0:1788305277.896140:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9682:x1875173741446016:12345-192.168.201.38@tcp:101:chmod.0 Request processed in 604us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305277.896153:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788305277.902359:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305277.902444:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741446272 00000100:00100000:1.0:1788305277.902460:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741446272 00000100:00100000:1.0:1788305277.902545:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1788305277.902558:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9682:x1875173741446272:12345-192.168.201.38@tcp:36:chmod.0 00010000:00010000:1.0:1788305277.902653:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305277.902691:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae85b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3dc expref: 7 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305277.902718:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:1.0:1788305277.902730:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305277.902764:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305277.902780:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305277.902792:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305277.903278:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048df6262 reply state 00000000c78bd4ad transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305277.903291:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788305277.903308:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788305277.903423:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+8:9682:x1875173741446272:12345-192.168.201.38@tcp:36:chmod.0 Request processed in 866us (1071us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788305277.903432:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00010000:00010000:0.0:1788305277.906432:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305277.906451:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305277.906459:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305277.906465:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305277.906469:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305277.906476:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305277.906494:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:0.0:1788305277.906496:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788305277.906500:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305277.906506:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae85bb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305277.955203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305277.955336:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741446400 00000100:00100000:2.0:1788305277.955352:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741446400 00000100:00100000:2.0:1788305277.955519:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1788305277.955531:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9683:x1875173741446400:12345-192.168.201.38@tcp:101:chown.0 00010000:00010000:2.0:1788305277.955557:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305277.955582:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae85c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3e3 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.955650:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c000/0x902a3611c9ae85c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.955666:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c000/0x902a3611c9ae85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.955678:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c000/0x902a3611c9ae85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305277.955740:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788305277.955744:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305277.955787:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c000/0x902a3611c9ae85c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.955815:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae85c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3e3 expref: 9 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.955833:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c000/0x902a3611c9ae85c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3e3 expref: 8 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.955842:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992e00) 00010000:00010000:2.0:1788305277.955845:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305277.955849:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c000, rc 0) 00000100:00100000:2.0:1788305277.955921:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:9683:x1875173741446400:12345-192.168.201.38@tcp:101:chown.0 Request processed in 393us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305277.955935:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788305277.962271:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305277.962358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741446528 00000100:00100000:2.0:1788305277.962375:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741446528 00000100:00100000:2.0:1788305277.962455:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788305277.962467:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:9683:x1875173741446528:12345-192.168.201.38@tcp:101:chown.0 00010000:00010000:2.0:1788305277.962487:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305277.962509:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae85d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3ea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962579:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962594:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962605:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962619:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962625:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962631:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962733:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae85e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962757:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae85e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962764:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae85e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305277.962800:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788305277.962803:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305277.962825:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae85e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962836:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962843:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962849:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962856:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305277.962860:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962868:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962880:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992e00) 00010000:00010000:2.0:1788305277.962884:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305277.962888:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962904:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae85d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962917:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962923:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962928:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962933:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7dc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305277.962936:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962941:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962948:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96fb88992d00) 00010000:00010000:2.0:1788305277.962950:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305277.962953:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962958:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae85de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.962999:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae85d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ea expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.963012:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae85e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ea expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305277.963028:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fb88992600) 00010000:00010000:2.0:1788305277.963030:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305277.963033:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ce00, rc 0) 00000100:00100000:2.0:1788305277.963210:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:9683:x1875173741446528:12345-192.168.201.38@tcp:101:chown.0 Request processed in 744us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305277.963218:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1788305277.971173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305277.971576:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741446784 00000100:00100000:1.0:1788305277.971595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741446784 00000100:00100000:1.0:1788305277.971692:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305277.971708:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:9683:x1875173741446784:12345-192.168.201.38@tcp:36:chown.0 00010000:00010000:1.0:1788305277.971793:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305277.971844:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae85e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ea expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305277.971871:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fb88992600) 00010000:00010000:1.0:1788305277.971884:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305277.971940:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305277.971955:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305277.971982:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305278.023558:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788305278.023634:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094d50b73 reply state 0000000048a46b94 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305278.023649:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788305278.023815:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1788305278.023951:0:5833:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788305278.024019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9683:x1875173741446784:12345-192.168.201.38@tcp:36:chown.0 Request processed in 52312us (52852us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788305278.024029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00010000:00010000:3.0:1788305278.024575:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.024586:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.024593:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.024599:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305278.024603:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.024611:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.024637:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39900) 00010000:00010000:3.0:1788305278.024640:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305278.024645:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.024650:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae85ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305278.047455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305278.047627:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741446912 00000100:00100000:1.0:1788305278.047638:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741446912 00000100:00100000:1.0:1788305278.047704:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788305278.047714:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:9684:x1875173741446912:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:1.0:1788305278.047739:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305278.047762:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae85f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305278.054377:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6529us 00010000:00010000:1.0:1788305278.080707:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.080731:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.080743:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.080759:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.080766:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.080772:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081479:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081490:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081498:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305278.081664:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788305278.081669:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305278.081756:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081778:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081784:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081790:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081796:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305278.081800:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081806:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081818:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992e00) 00010000:00010000:1.0:1788305278.081822:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305278.081826:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081834:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e600/0x902a3611c9ae85fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081845:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081851:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081856:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081867:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305278.081870:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081876:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081885:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96fbb5e39e00) 00010000:00010000:1.0:1788305278.081887:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305278.081890:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081896:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081935:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae85f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3f1 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081949:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3f1 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.081957:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:1.0:1788305278.081960:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788305278.081972:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f800, rc 0) 00000100:00100000:1.0:1788305278.082139:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9684:x1875173741446912:12345-192.168.201.38@tcp:101:touch.500 Request processed in 34425us (34693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305278.082148:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788305278.087894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.088128:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741447168 00000100:00100000:2.0:1788305278.088140:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741447168 00000100:00100000:2.0:1788305278.088210:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788305278.088222:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9684:x1875173741447168:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:2.0:1788305278.088242:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305278.088265:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae860f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3f8 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.088605:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.088620:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.088631:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.088687:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.088695:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.088715:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305278.090558:0:8201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788305278.091172:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091200:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091211:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091249:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091257:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091264:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091271:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305278.091276:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091284:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091297:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:2.0:1788305278.091301:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305278.091313:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091320:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8616 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305278.091333:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004250d8d8 reply state 000000004429242f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305278.091342:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788305278.091383:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae860f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3f8 expref: 10 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091400:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3f8 expref: 9 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.091408:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fb88992500) 00010000:00010000:2.0:1788305278.091411:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305278.091414:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c200, rc 0) 00000100:00100000:2.0:1788305278.091500:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+10:9684:x1875173741447168:12345-192.168.201.38@tcp:101:touch.500 Request processed in 3280us (3616us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788305278.091509:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788305278.099002:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.099457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741447424 00000100:00100000:3.0:1788305278.099466:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741447424 00000100:00100000:3.0:1788305278.099528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:3.0:1788305278.099538:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+10:9684:x1875173741447424:12345-192.168.201.38@tcp:36:touch.500 00010000:00010000:3.0:1788305278.099595:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305278.099625:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3f8 expref: 10 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.099625:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.099643:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fb88992500) 00010000:00010000:1.0:1788305278.099645:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.099656:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305278.099656:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.099664:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7dc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305278.099669:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.099676:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.099686:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff96fb88992d00) 00010000:00010000:1.0:1788305278.099689:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305278.099693:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.099699:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae861d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.099884:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.099912:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.099922:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305278.100460:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001177c5c0 reply state 00000000e8e2142b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305278.100472:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305278.100581:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+10:9684:x1875173741447424:12345-192.168.201.38@tcp:36:touch.500 Request processed in 1042us (1585us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788305278.100589:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00010000:00010000:3.0:1788305278.102953:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.102983:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.102991:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.102998:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305278.103002:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.103010:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.103028:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305278.103031:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305278.103035:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.103041:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305278.106110:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305278.113031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741447552 00000100:00100000:1.0:1788305278.113049:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741447552 00000100:00100000:1.0:1788305278.113153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1788305278.113164:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:9684:x1875173741447552:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:1.0:1788305278.113407:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305278.113433:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a3ff expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.113518:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ff expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.113532:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ff expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.113553:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fbb5e39e00) 00010000:00010000:1.0:1788305278.113556:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305278.113560:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305278.113667:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:9684:x1875173741447552:12345-192.168.201.38@tcp:101:touch.500 Request processed in 504us (7564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305278.113675:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788305278.120104:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.122090:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741447680 00000100:00100000:2.0:1788305278.122105:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741447680 00000100:00100000:2.0:1788305278.122284:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788305278.122293:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875173741447680:12345-192.168.201.38@tcp:8:touch.500 00010000:00080000:2.0:1788305278.122328:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:2.0:1788305278.122376:0:6677:0:(genops.c:1385:class_connect()) connect: client 5455d24f-893c-4899-b5f9-16679e9a93aa, cookie 0x902a3611c9ae8640 00002000:00100000:2.0:1788305278.122388:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5455d24f-893c-4899-b5f9-16679e9a93aa/ffff96fbbd7f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305278.122410:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305278.122655:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788305278.122688:0:6677:0:(import.c:65:import_set_state_nolock()) ffff96fbbd7f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305278.122773:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2346:x1875173741447680:12345-192.168.201.38@tcp:8:touch.500 Request processed in 480us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305278.122781:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788305278.132556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.132660:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741447808 00000100:00100000:2.0:1788305278.132670:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741447808 00000100:00100000:2.0:1788305278.132749:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1788305278.132762:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:0:x1875173741447808:12345-192.168.201.38@tcp:2:touch.500 00000100:00080000:0.0:1788305278.133204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305278.178272:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:0:x1875173741447808:12345-192.168.201.38@tcp:2:touch.500 Request processed in 45501us (45714us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788305278.178287:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000001:00080000:1.0:1788305278.179405:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788305278.179421:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000100:00100000:1.0:1788305278.183814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.184324:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741448064 00000100:00100000:3.0:1788305278.184334:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741448064 00000100:00100000:3.0:1788305278.184394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788305278.184402:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:9684:x1875173741448064:12345-192.168.201.38@tcp:35:touch.500 00000100:00100000:3.0:1788305278.184724:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+11:9684:x1875173741448064:12345-192.168.201.38@tcp:35:touch.500 Request processed in 321us (920us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788305278.184732:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:1.0:1788305278.217499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.217606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741448192 00000100:00100000:2.0:1788305278.217617:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741448192 00000100:00100000:2.0:1788305278.217677:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788305278.217688:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+11:9685:x1875173741448192:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:2.0:1788305278.217712:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305278.217734:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a406 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.217799:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae864e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.217812:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae864e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.217822:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae864e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305278.217894:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788305278.217898:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305278.217944:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae864e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.217984:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a406 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.218001:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae864e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a406 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.218009:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:2.0:1788305278.218012:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305278.218015:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c600, rc 0) 00000100:00100000:2.0:1788305278.218121:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+12:9685:x1875173741448192:12345-192.168.201.38@tcp:101:rm.0 Request processed in 434us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305278.218128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1788305278.226442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.226717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741448448 00000100:00100000:3.0:1788305278.226726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741448448 00000100:00100000:3.0:1788305278.226779:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:3.0:1788305278.226789:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+12:9685:x1875173741448448:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:3.0:1788305278.226819:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305278.226839:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a40d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305278.226931:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788305278.227234:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8655 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a40d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.227248:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992e00) 00010000:00010000:3.0:1788305278.227250:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305278.227254:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a40d expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.227265:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd400, rc 0) 00000100:00100000:3.0:1788305278.227317:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:9685:x1875173741448448:12345-192.168.201.38@tcp:101:rm.0 Request processed in 530us (888us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788305278.227330:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:1.0:1788305278.235277:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.235442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741448576 00000100:00100000:3.0:1788305278.235452:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741448576 00000100:00100000:3.0:1788305278.235509:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1788305278.235519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:9685:x1875173741448576:12345-192.168.201.38@tcp:37:rm.0 00000100:00100000:2.0:1788305278.241669:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:9685:x1875173741448576:12345-192.168.201.38@tcp:37:rm.0 Request processed in 6142us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305278.241682:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788305278.247518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305278.247697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741448832 00000100:00100000:1.0:1788305278.247707:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741448832 00000100:00100000:1.0:1788305278.247764:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:1.0:1788305278.247773:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:9685:x1875173741448832:12345-192.168.201.38@tcp:35:rm.0 00000100:00100000:1.0:1788305278.248592:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+14:9685:x1875173741448832:12345-192.168.201.38@tcp:35:rm.0 Request processed in 813us (1090us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788305278.248601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:1.0:1788305278.253301:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.253438:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741449088 00000100:00100000:2.0:1788305278.253448:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741449088 00000100:00100000:2.0:1788305278.253565:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788305278.253577:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+14:9685:x1875173741449088:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:2.0:1788305278.253604:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305278.253626:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a414 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.253763:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae866a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.253777:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae866a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.253790:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae866a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305278.253801:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788305278.253929:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a414 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.253947:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae866a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a414 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.265373:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:2.0:1788305278.265385:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305278.265390:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ce00, rc 0) 00000100:00100000:2.0:1788305278.265471:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741449088:12345-192.168.201.38@tcp:101:rm.0 Request processed in 11892us (12176us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788305278.265478:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788305278.269422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.269493:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741449216 00000100:00100000:2.0:1788305278.269515:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741449216 00000100:00100000:2.0:1788305278.269574:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:2.0:1788305278.269585:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741449216:12345-192.168.201.38@tcp:41:rm.0 00000004:00000024:2.0:1788305278.269644:0:8201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788305278.269727:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741449216:12345-192.168.201.38@tcp:41:rm.0 Request processed in 143us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305278.269735:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788305278.272652:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.272704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741449344 00000100:00100000:3.0:1788305278.272715:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741449344 00000100:00100000:3.0:1788305278.272829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:3.0:1788305278.272842:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741449344:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:3.0:1788305278.272864:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305278.272888:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a41b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.272977:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.272992:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.273004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.273020:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.273027:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.273091:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273637:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273644:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273650:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305278.273675:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788305278.273679:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305278.273696:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273705:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273710:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273715:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273727:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273731:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305278.273734:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273739:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273748:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:0.0:1788305278.273750:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305278.273753:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273757:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae867f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273767:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273771:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273774:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273778:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fda00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305278.273779:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273791:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273796:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff96fb87f88900) 00010000:00010000:0.0:1788305278.273797:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305278.273799:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273802:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273833:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a41b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273846:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a41b expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.273853:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fbb5e39e00) 00010000:00010000:0.0:1788305278.273855:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305278.273857:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031400, rc 0) 00000100:00100000:0.0:1788305278.273930:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+17:9685:x1875173741449344:12345-192.168.201.38@tcp:101:rm.0 Request processed in 1090us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.273937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:1.0:1788305278.277570:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.277629:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741449600 00000100:00100000:3.0:1788305278.277640:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741449600 00000100:00100000:3.0:1788305278.277707:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788305278.277718:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+17:9685:x1875173741449600:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:3.0:1788305278.277771:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788305278.277800:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031400/0x902a3611c9ae868d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a41b expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277833:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ff expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277843:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fbb5e39e00) 00010000:00010000:3.0:1788305278.277858:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae864e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a406 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277866:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:3.0:1788305278.277869:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305278.277889:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277901:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277910:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277941:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.277968:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.278184:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.278193:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.278201:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305278.278885:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788305278.278896:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295988841811ns, next at 296988839303ns, rc = 0 00010000:00010000:3.0:1788305278.278979:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.278991:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279001:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279009:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279026:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279033:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279083:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305278.279116:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305278.279123:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.279130:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbda00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305278.279140:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.279148:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.279158:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fb87f88a00) 00010000:00010000:0.0:1788305278.279161:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305278.279164:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.279169:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae86a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305278.279181:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305278.279183:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305278.279185:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305278.279649:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279658:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279664:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279669:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305278.279673:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279678:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279687:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96fb87f88a00) 00010000:00010000:3.0:1788305278.279689:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788305278.279692:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279698:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc000/0x902a3611c9ae86a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279718:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279730:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279735:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279740:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305278.279743:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279748:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279756:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:3.0:1788305278.279758:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305278.279761:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.279767:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8694 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305278.279776:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007442f88d reply state 0000000017039596 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305278.279784:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305278.279883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741449600:12345-192.168.201.38@tcp:36:rm.0 Request processed in 2162us (2318us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788305278.279891:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00010000:00010000:1.0:1788305278.282367:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.282384:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.282391:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.282396:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305278.282401:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.282408:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.282424:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff96fb87f88600) 00010000:00010000:1.0:1788305278.282427:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305278.282431:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305278.282437:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae869b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305278.283682:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.283745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741449856 00000100:00100000:2.0:1788305278.283756:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741449856 00000100:00100000:2.0:1788305278.283998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1788305278.284010:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:9685:x1875173741449856:12345-192.168.201.38@tcp:35:rm.0 00000100:00100000:2.0:1788305278.284315:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741449856:12345-192.168.201.38@tcp:35:rm.0 Request processed in 306us (636us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788305278.284322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1788305278.288102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.289133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450112 00000100:00100000:3.0:1788305278.289156:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450112 00000100:00100000:3.0:1788305278.289227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1788305278.289238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+16:9685:x1875173741450112:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:3.0:1788305278.289295:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788305278.289323:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae866a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a414 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.289346:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3f1 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.289357:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fbb5e39200) 00010000:00010000:3.0:1788305278.289373:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c000/0x902a3611c9ae85c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3e3 expref: 14 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.289382:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992e00) 00010000:00010000:3.0:1788305278.289389:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305278.289451:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289465:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289475:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289490:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289497:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289504:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289886:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289906:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.289914:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305278.290915:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788305278.290933:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.290940:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.290945:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.290949:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7dc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305278.291004:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291013:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291026:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305278.291029:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788305278.291033:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291040:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae86be lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291163:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291174:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291179:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291184:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305278.291187:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291193:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291203:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb87f88f00) 00010000:00010000:2.0:1788305278.291205:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305278.291208:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305278.291214:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae86b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305278.291228:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1e835a reply state 00000000a10d79f1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305278.291238:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305278.291350:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+15:9685:x1875173741450112:12345-192.168.201.38@tcp:36:rm.0 Request processed in 2111us (3254us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788305278.291356:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00010000:00010000:3.0:1788305278.305512:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.305528:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.305536:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.305543:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305278.305548:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.305573:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.305589:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96fb88992b00) 00010000:00010000:3.0:1788305278.305592:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305278.305597:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305278.305603:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae86b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305278.603205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305278.603278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305278.603344:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450368 00000100:00100000:2.0:1788305278.603361:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450368 00000100:00100000:0.0:1788305278.603370:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450240 00000100:00100000:0.0:1788305278.603374:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450240 00000100:00100000:2.0:1788305278.603450:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:0.0:1788305278.603450:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 249 00000100:00100000:2.0:1788305278.603460:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741450368:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305278.603460:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741450240:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:3.0:1788305278.603624:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305278.603804:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741450368:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 345us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305278.603813:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:0.0:1788305278.608929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741450240:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 5459us (5639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.608945:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 249 00000100:00100000:0.0:1788305278.706485:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761405440:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.706564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305278.706625:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875173761405952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.706654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305278.706680:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305278.706701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761405824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.706729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305278.706776:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405440 00000100:00100000:0.0:1788305278.706784:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405440 00000100:00100000:0.0:1788305278.706847:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788305278.706858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3304:x1875173761405440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.706911:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3304:x1875173761405440:12345-0@lo:400:kworker.0 Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.706918:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788305278.706963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405952 00000100:00100000:0.0:1788305278.706966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405952 00000100:00100000:0.0:1788305278.707002:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305278.707009:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875173761405952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707043:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875173761405952:12345-0@lo:400:kworker.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.707048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788305278.707089:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305278.707114:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761405440:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707127:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875173761405952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707175:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761405696:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707199:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305278.707217:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788305278.707221:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761405568:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707239:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305278.707252:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761406080:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305278.707317:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405824 00000100:00100000:0.0:1788305278.707321:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405824 00000100:00100000:0.0:1788305278.707351:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761406080 00000100:00100000:0.0:1788305278.707354:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761406080 00000100:00100000:0.0:1788305278.707367:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788305278.707372:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761405824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707409:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761405824:12345-0@lo:400:kworker.0 Request processed in 37us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.707415:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788305278.707425:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788305278.707431:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761406080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707459:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761406080:12345-0@lo:400:kworker.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.707467:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788305278.707482:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305278.707485:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788305278.707502:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9f6c380 x1875173761406080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305278.707513:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761406080:0@lo:400:kworker.0 00010000:00080000:0.0:1788305278.707536:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9f6d880 x1875173761405824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305278.707544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761405824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707560:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405696 00000100:00100000:0.0:1788305278.707563:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405696 00000100:00100000:0.0:1788305278.707589:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761405568 00000100:00100000:0.0:1788305278.707598:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761405568 00000100:00100000:0.0:1788305278.707616:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305278.707621:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761405696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707652:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761405696:12345-0@lo:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.707657:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305278.707666:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788305278.707672:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761405568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707694:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761405568:12345-0@lo:400:kworker.0 Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305278.707699:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788305278.707709:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305278.707724:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761405568:0@lo:400:kworker.0 00000100:00100000:0.0:1788305278.707732:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761405696:0@lo:400:kworker.0 00010000:00010000:3.0:1788305278.833616:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305279.220173:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305279.220196:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761406208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305279.220266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305279.220329:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761406208 00000100:00100000:2.0:1788305279.220337:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761406208 00000100:00100000:2.0:1788305279.220382:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305279.220392:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761406208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305279.220427:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305279.220472:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761406208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305279.220480:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788305279.220521:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9f6ca80 x1875173761406208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305279.220539:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761406208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305279.222047:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305279.222083:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761406336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305279.222135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305279.222270:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761406336 00000100:00100000:3.0:1788305279.222277:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761406336 00000100:00100000:3.0:1788305279.222315:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305279.222324:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761406336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305279.222344:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305279.222384:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761406336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305279.222391:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788305279.222459:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0598700 x1875173761406336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305279.222490:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761406336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305279.858608:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305280.881360:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305281.910712:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305282.222014:0:11606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788305282.929516:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788305283.299556:0:11654:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca9147070 20000000:00000080:3.0:1788305283.299577:0:11654:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fbb9963000 uarg=0000000000000000 20000000:01000000:3.0:1788305283.299614:0:11654:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788305283.299628:0:11654:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788305283.299633:0:11654:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788305283.300805:0:11655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788305283.300980:0:11654:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788305283.308004:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788305283.308243:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788305283.308300:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788305283.308316:0:11654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305283.308336:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308365:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308375:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308382:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae857c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308390:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae858a expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308397:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308403:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308439:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308453:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 12 pid: 5828 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.308468:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406464:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305283.308601:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae858a expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308609:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae858a expref: 18 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.308625:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406592:0@lo:104: 00000100:00100000:2.0:1788305283.308672:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305283.308711:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae857c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308718:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae857c expref: 18 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.308727:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406720:0@lo:104: 00000100:00100000:2.0:1788305283.308745:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305283.308772:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308780:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.308789:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406848:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305283.308813:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305283.308821:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 18 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.308829:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406976:0@lo:104: 00000100:00100000:2.0:1788305283.308850:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305283.308858:0:11654:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82ca4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305283.308978:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788305283.308990:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761406592 00000100:00100000:1.0:1788305283.308996:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761406592 00000100:00100000:1.0:1788305283.309027:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761406720 00000100:00100000:1.0:1788305283.309029:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761406720 00000100:00100000:1.0:1788305283.309037:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761406976 00000100:00100000:1.0:1788305283.309039:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761406976 00000100:00100000:1.0:1788305283.309050:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305283.309085:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+5:11654:x1875173761406592:12345-0@lo:104: 00010000:00010000:1.0:1788305283.309104:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309156:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305283.309162:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+5:11654:x1875173761406592:12345-0@lo:104: Request processed in 80us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.309169:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305283.309184:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305283.309189:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+4:11654:x1875173761406720:12345-0@lo:104: 00010000:00010000:1.0:1788305283.309196:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309222:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788305283.309226:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+4:11654:x1875173761406720:12345-0@lo:104: Request processed in 38us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.309232:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305283.309249:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305283.309254:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf481450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:11654:x1875173761406976:12345-0@lo:104: 00010000:00010000:1.0:1788305283.309260:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309289:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788305283.309293:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf481450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:16674bd8-0f21-440d-92a6-ff3988850e9b+3:11654:x1875173761406976:12345-0@lo:104: Request processed in 40us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.309299:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788305283.309334:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788305283.309340:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309346:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305283.309350:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309359:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305283.309366:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305283.309372:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305283.309397:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309403:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305283.309421:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309437:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc400/0x902a3611c9ae858a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8591 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309449:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305283.309452:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309458:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7ca00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305283.309461:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309468:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305283.309474:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305283.309480:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305283.309490:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309495:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305283.309508:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309514:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7ca00/0x902a3611c9ae857c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae8583 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309521:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305283.309528:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309534:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305283.309536:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309543:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305283.309549:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305283.309555:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305283.309565:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309571:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305283.309576:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309582:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc000/0x902a3611c9ae8567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae856e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309592:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305283.309594:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305283.309596:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305283.309602:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305283.309618:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761407104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305283.309650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305283.309693:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761407232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305283.309718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305283.309734:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305283.309739:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761407360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305283.309757:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305283.309780:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407104 00000100:00100000:1.0:1788305283.309784:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407104 00010000:00010000:1.0:1788305283.309800:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae858a expref: 19 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305283.309818:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407232 00000100:00100000:1.0:1788305283.309820:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407232 00010000:00010000:1.0:1788305283.309829:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae857c expref: 20 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305283.309838:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407360 00000100:00100000:1.0:1788305283.309840:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407360 00010000:00010000:1.0:1788305283.309846:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 21 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305283.309857:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788305283.309862:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+21:3304:x1875173761407104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305283.309870:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305283.309886:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae858a expref: 21 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309895:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae858a expref: 21 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309909:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305283.309932:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+21:3304:x1875173761407104:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.309942:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788305283.309952:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788305283.309957:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+20:3301:x1875173761407232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305283.309962:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305283.309966:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae857c expref: 20 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309972:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae857c expref: 20 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.309980:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305283.309998:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+20:3301:x1875173761407232:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.310003:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788305283.310012:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305283.310016:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83072050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761407360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305283.310021:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305283.310025:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 19 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.310031:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 19 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.310038:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305283.310069:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83072050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761407360:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.310075:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305283.310127:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761407104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305283.310151:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761407360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305283.310157:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761407232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305283.310648:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd200/0x902a3611c9ae8591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae858a expref: 18 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.310686:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406592:0@lo:104: 00010000:00010000:2.0:1788305283.310700:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae857c expref: 17 pid: 5828 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.310710:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406720:0@lo:104: 00010000:00010000:2.0:1788305283.310719:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071fc00/0x902a3611c9ae856e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae8567 expref: 16 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305283.310727:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406976:0@lo:104: 00000100:00100000:2.0:1788305283.313743:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406464:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305283.329180:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305283.329252:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305283.329318:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450496 00000100:00100000:1.0:1788305283.329327:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450496 00010000:00010000:1.0:1788305283.329368:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 13 pid: 5828 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305283.329407:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450624 00000100:00100000:1.0:1788305283.329410:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450624 00010000:00010000:1.0:1788305283.329422:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 14 pid: 5826 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305283.329441:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:1.0:1788305283.329456:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+14:2348:x1875173741450496:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305283.329470:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305283.329476:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 14 pid: 5828 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.329489:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 14 pid: 5828 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.329506:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071f200/0x902a3611c9ae8598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3d5 expref: 14 pid: 5828 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305283.329520:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305283.329571:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741450496:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 122us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305283.329678:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875173761406848:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305283.329721:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305283.331838:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:1.0:1788305283.331847:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:0.0:1788305283.331858:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2348:x1875173741450624:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305283.331885:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305283.331894:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331908:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331924:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071ee00/0x902a3611c9ae8575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a3ce expref: 12 pid: 5826 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331950:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331958:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331974:0:8499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331980:0:8499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331986:0:8499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331992:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.331998:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305283.332003:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.332011:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.332032:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.332043:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305283.332104:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2348:x1875173741450624:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 254us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305283.332118:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00010000:00010000:3.0:1788305283.332181:0:11654:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305283.332189:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305283.332196:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7c200/0x902a3611c9ae86c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305283.355791:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:2.0:1788305283.355813:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788305283.355830:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788305283.356096:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761407488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788305283.356166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305283.356407:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407488 00000100:00100000:0.0:1788305283.356415:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407488 00000100:00100000:0.0:1788305283.356469:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305283.356481:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761407488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788305283.356508:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788305283.356541:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a975f7d, atime: 0x6a975f7d, ctime: 0x6a975f7d, blocks: 0x1 00010000:00010000:0.0:1788305283.356550:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.356566:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788305283.356570:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305283.356576:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.356594:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.356603:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.356610:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.356627:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788305283.357269:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761407488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 790us (1100us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788305283.357283:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788305283.357306:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788305283.357320:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305283.357326:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.357335:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305283.357339:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305283.357415:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fb88e38a80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788305283.357422:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761407488:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788305283.357634:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.357714:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.357723:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae86cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305283.357743:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305283.357745:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305283.357746:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305283.722040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305283.722219:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305283.722260:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305283.722296:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305283.722301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450880 00000100:00100000:1.0:1788305283.722314:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450880 00000100:00100000:3.0:1788305283.722321:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451008 00000100:00100000:3.0:1788305283.722326:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451008 00000100:00100000:1.0:1788305283.722376:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451136 00000100:00100000:1.0:1788305283.722381:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451136 00000100:00100000:2.0:1788305283.722391:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741450752 00000100:00100000:2.0:1788305283.722395:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741450752 00000100:00100000:2.0:1788305283.722424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 251 00000100:00100000:2.0:1788305283.722433:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2349:x1875173741450752:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305283.722476:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:0.0:1788305283.722493:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741450880:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305283.722499:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2349:x1875173741450752:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305283.722508:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 251 00000100:00100000:0.0:1788305283.722550:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741450880:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 63us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305283.722574:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:1.0:1788305283.728039:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:1.0:1788305283.728068:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741451136:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:2.0:1788305283.728216:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305283.728222:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305283.728418:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741451136:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 365us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305283.728426:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:3.0:1788305283.735671:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:3.0:1788305283.735687:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741451008:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305283.735805:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741451008:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 122us (13507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305283.735814:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:0.0:1788305283.825428:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761407872:0@lo:400:kworker.0 00000100:00100000:0.0:1788305283.825501:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305283.825571:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305283.825578:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761407744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305283.825601:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305283.825629:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407872 00000100:00100000:0.0:1788305283.825636:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407872 00000100:00100000:0.0:1788305283.825687:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407744 00000100:00100000:0.0:1788305283.825690:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407744 00000100:00100000:0.0:1788305283.825714:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305283.825723:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761407872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305283.825771:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761407872:12345-0@lo:400:kworker.0 Request processed in 50us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305283.825779:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305283.825794:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788305283.825801:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761407744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305283.825827:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761407744:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305283.825832:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788305283.825855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305283.825978:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761407616:0@lo:400:kworker.0 00000100:00100000:2.0:1788305283.826019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305283.826039:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305283.826076:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761408000:0@lo:400:kworker.0 00000100:00100000:2.0:1788305283.826115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305283.826154:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408000 00000100:00100000:2.0:1788305283.826159:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408000 00000100:00100000:2.0:1788305283.826192:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305283.826199:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761408000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305283.826233:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761408000:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305283.826239:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788305283.826270:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb88e3bb80 x1875173761408000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305283.826284:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761408000:0@lo:400:kworker.0 00000100:00100000:3.0:1788305283.826519:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761407616 00000100:00100000:3.0:1788305283.826524:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761407616 00000100:00100000:3.0:1788305283.826560:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305283.826567:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761407616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305283.826605:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761407616:12345-0@lo:400:kworker.0 Request processed in 39us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305283.826611:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305283.826634:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761407616:0@lo:400:kworker.0 00000100:00080000:3.0:1788305283.826654:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305283.826722:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761407744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305283.826732:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761407872:0@lo:400:kworker.0 00010000:00010000:1.0:1788305283.953663:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305284.337233:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761408128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305284.337309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305284.337497:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408128 00000100:00100000:2.0:1788305284.337505:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408128 00000100:00100000:2.0:1788305284.337554:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305284.337563:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761408128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305284.337595:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305284.337657:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761408128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305284.337664:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305284.337819:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305284.337829:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761408256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305284.337866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305284.337910:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408256 00000100:00100000:1.0:1788305284.337914:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408256 00010000:00080000:0.0:1788305284.337916:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbb9f6d500 x1875173761408128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305284.337940:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305284.337948:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761408256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305284.337951:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761408128:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305284.337971:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305284.338010:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761408256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305284.338017:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305284.338048:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761408256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305284.877838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305284.877950:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451264 00000100:00100000:1.0:1788305284.877960:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451264 00000100:00100000:1.0:1788305284.878128:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 252 00000100:00100000:1.0:1788305284.878153:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:5590:x1875173741451264:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305284.878178:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305284.878198:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae86d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305284.878235:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae86d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a422 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305284.878246:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae86d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a422 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305284.878256:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e200, rc 0) 00000100:00100000:1.0:1788305284.878317:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88ead450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741451264:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 166us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305284.878324:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 252 00000100:00100000:1.0:1788305284.883906:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305284.884863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451392 00000100:00100000:0.0:1788305284.884876:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451392 00000100:00100000:0.0:1788305284.884978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 253 00000100:00100000:0.0:1788305284.884990:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741451392:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305284.885294:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741451392:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 305us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305284.885303:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 253 00000100:00100000:3.0:1788305284.889439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305284.889548:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451520 00000100:00100000:1.0:1788305284.889558:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451520 00000100:00100000:1.0:1788305284.889658:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 254 00000100:00100000:1.0:1788305284.889668:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741451520:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305284.889906:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741451520:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 239us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305284.889915:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 254 00000100:00100000:1.0:1788305284.901457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305284.901546:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451648 00000100:00100000:0.0:1788305284.901557:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451648 00000100:00100000:0.0:1788305284.901623:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 255 00000100:00100000:0.0:1788305284.901634:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:9955:x1875173741451648:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305284.901955:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:9955:x1875173741451648:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 322us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305284.901964:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 255 00000100:00100000:3.0:1788305284.906488:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305284.906612:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451776 00000100:00100000:1.0:1788305284.906623:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451776 00000100:00100000:1.0:1788305284.906735:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 256 00000100:00100000:1.0:1788305284.906760:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:9955:x1875173741451776:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305284.907046:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:9955:x1875173741451776:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 287us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305284.907091:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 256 00000100:00100000:3.0:1788305284.921493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305284.921606:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741451904 00000100:00100000:2.0:1788305284.921618:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741451904 00000100:00100000:2.0:1788305284.921679:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:2.0:1788305284.921690:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:5590:x1875173741451904:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305284.921713:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305284.921732:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae86da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a429 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305284.921775:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae86da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a429 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305284.921786:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae86da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a429 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305284.921796:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c000, rc 0) 00000100:00100000:2.0:1788305284.921862:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741451904:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 173us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305284.921870:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:2.0:1788305284.925814:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305284.925924:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452032 00000100:00100000:1.0:1788305284.925935:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452032 00000100:00100000:1.0:1788305284.926004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00100000:1.0:1788305284.926016:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741452032:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305284.926369:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741452032:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 355us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305284.926378:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00100000:3.0:1788305284.930184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305284.934148:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452160 00000100:00100000:0.0:1788305284.934168:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452160 00000100:00100000:0.0:1788305284.934240:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00100000:0.0:1788305284.934252:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741452160:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305284.934510:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:5590:x1875173741452160:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 259us (4336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305284.934519:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00100000:3.0:1788305284.945944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305284.946883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452288 00000100:00100000:2.0:1788305284.946896:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452288 00000100:00100000:2.0:1788305284.946966:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 260 00000100:00100000:2.0:1788305284.946978:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:9958:x1875173741452288:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305284.947288:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:9958:x1875173741452288:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 311us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305284.947296:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 260 00000100:00100000:2.0:1788305284.951348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305284.951447:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452416 00000100:00100000:1.0:1788305284.951457:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452416 00000100:00100000:1.0:1788305284.951515:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 261 00000100:00100000:1.0:1788305284.951527:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:9958:x1875173741452416:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305284.951796:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:9958:x1875173741452416:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 270us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305284.951804:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 261 00010000:00010000:0.0:1788305284.981223:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788305285.105237:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305285.105245:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fa818a7800 from 7 10000000:01000000:1.0:1788305285.105251:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305285.105309:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305285.105324:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305285.105354:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305285.105381:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761408384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305285.105462:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305285.105547:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90f38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.105684:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408384 00000100:00100000:0.0:1788305285.105692:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408384 00000100:00100000:0.0:1788305285.105756:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788305285.105767:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+16:5830:x1875173761408384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305285.105781:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305285.105795:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030200/0x902a3611c9ae86e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae86e1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.105820:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030200/0x902a3611c9ae86e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae86e1 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.105830:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030200/0x902a3611c9ae86e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae86e1 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.105839:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030200, rc 0) 00000100:00100000:0.0:1788305285.105933:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761408384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.105940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788305285.106176:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761408384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305285.106193:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305285.106203:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305285.106274:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761408512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305285.106307:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305285.106338:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82ca4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.106526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408512 00000100:00100000:0.0:1788305285.106532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408512 00000100:00100000:0.0:1788305285.106568:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788305285.106576:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761408512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.106926:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761408512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.106933:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788305285.109612:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761408512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305285.109681:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761408640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305285.109758:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305285.109808:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb83162840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305285.109923:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408640 00000100:00100000:2.0:1788305285.109930:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408640 00000100:00100000:2.0:1788305285.109996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788305285.110006:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761408640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305285.110251:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761408640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305285.110259:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788305285.110500:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761408640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305285.111696:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11669:1875173761408768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305285.111757:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305285.111801:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb83162c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305285.111881:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408768 00000100:00100000:1.0:1788305285.111888:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408768 00000100:00100000:1.0:1788305285.111932:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788305285.111942:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:11669:x1875173761408768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305285.112454:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb890ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:11669:x1875173761408768:12345-0@lo:502:llog_process_th.0 Request processed in 512us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305285.112463:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788305285.113326:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11669:1875173761408768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305285.113366:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305285.113377:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305285.113380:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305285.113386:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96fa818a7800 00000020:00000080:3.0:1788305285.113389:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788305285.113538:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11669:1875173761408896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305285.113593:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305285.113635:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb83162c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.113716:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761408896 00000100:00100000:0.0:1788305285.113722:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761408896 00000100:00100000:0.0:1788305285.113771:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788305285.113780:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:11669:x1875173761408896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.114007:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+17:11669:x1875173761408896:12345-0@lo:502:llog_process_th.0 Request processed in 228us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.114015:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788305285.115288:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11669:1875173761408896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305285.115330:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305285.115338:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305285.115340:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788305285.115345:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788305285.116255:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788305285.116283:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305285.116295:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.116306:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305285.116317:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305285.116321:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb95e7800 from 7 10000000:01000000:0.0:1788305285.116324:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305285.116358:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.116367:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.116377:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305285.116398:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.116457:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.116506:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba04636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305285.117515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409024 00000100:00100000:3.0:1788305285.117525:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409024 00000100:00100000:3.0:1788305285.117579:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788305285.117589:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+17:5830:x1875173761409024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305285.117603:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305285.117619:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbb9dbc000/0x902a3611c9ae86f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae86ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305285.117643:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbb9dbc000/0x902a3611c9ae86f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae86ef expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305285.117655:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbb9dbc000/0x902a3611c9ae86f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae86ef expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305285.117664:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc000, rc 0) 00000100:00100000:3.0:1788305285.117740:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761409024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305285.117748:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788305285.117883:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305285.117899:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305285.117909:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305285.117992:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305285.118030:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305285.118246:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305285.119201:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409152 00000100:00100000:3.0:1788305285.119212:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409152 00000100:00100000:3.0:1788305285.119259:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788305285.119268:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761409152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305285.119568:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761409152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305285.119576:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788305285.119744:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.119791:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.119858:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.119897:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305285.120281:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409280 00000100:00100000:3.0:1788305285.120287:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409280 00000100:00100000:3.0:1788305285.120435:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788305285.120444:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761409280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305285.120623:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761409280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305285.120630:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788305285.128237:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.128550:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11671:1875173761409408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.128623:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.128664:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409408 00000100:00100000:0.0:1788305285.128670:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409408 00000100:00100000:0.0:1788305285.128709:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788305285.128719:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:11671:x1875173761409408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.128970:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:11671:x1875173761409408:12345-0@lo:502:llog_process_th.0 Request processed in 239us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.128979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788305285.129029:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.129042:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11671:1875173761409408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305285.129091:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305285.129102:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305285.129104:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305285.129111:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96fbb95e7800 00000020:00000080:0.0:1788305285.129114:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788305285.129197:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11671:1875173761409536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.129232:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.129253:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409536 00000100:00100000:0.0:1788305285.129257:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409536 00000100:00100000:0.0:1788305285.129276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788305285.129283:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:11671:x1875173761409536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.129402:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:11671:x1875173761409536:12345-0@lo:502:llog_process_th.0 Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.129410:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788305285.129435:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.129446:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11671:1875173761409536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305285.129464:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305285.129469:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305285.129470:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788305285.129473:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788305285.129527:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788305285.129546:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305285.129555:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129567:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305285.129580:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305285.129583:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fb8951b000 from 7 10000000:01000000:0.0:1788305285.129586:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305285.129611:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129619:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129629:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305285.129643:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.129678:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.129693:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.129706:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409664 00000100:00100000:0.0:1788305285.129709:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409664 00000100:00100000:0.0:1788305285.129727:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788305285.129732:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+18:5830:x1875173761409664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305285.129741:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305285.129752:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8704 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae86fd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129772:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae86fd expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129781:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae86fd expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129790:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030a00, rc 0) 00000100:00100000:0.0:1788305285.129818:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761409664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.129825:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788305285.129869:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305285.129881:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.129890:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305285.129929:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.129965:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.129980:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.129991:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409792 00000100:00100000:0.0:1788305285.129995:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409792 00000100:00100000:0.0:1788305285.130011:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788305285.130017:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761409792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.130253:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761409792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.130261:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788305285.130289:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.130315:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.130347:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.130361:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.130372:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761409920 00000100:00100000:0.0:1788305285.130376:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761409920 00000100:00100000:0.0:1788305285.130394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788305285.130400:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761409920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.130508:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:5830:x1875173761409920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.130515:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788305285.130545:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:16674bd8-0f21-440d-92a6-ff3988850e9b:5830:1875173761409920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305285.130784:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11672:1875173761410048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.130818:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.130837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410048 00000100:00100000:0.0:1788305285.130859:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410048 00000100:00100000:0.0:1788305285.130880:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788305285.130887:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:11672:x1875173761410048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.131000:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:11672:x1875173761410048:12345-0@lo:502:llog_process_th.0 Request processed in 113us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.131007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788305285.131031:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.131042:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11672:1875173761410048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305285.131080:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305285.131088:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305285.131090:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305285.131095:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96fb8951b000 00000020:00000080:0.0:1788305285.131097:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788305285.131151:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11672:1875173761410176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.131181:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305285.131199:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410176 00000100:00100000:0.0:1788305285.131202:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410176 00000100:00100000:0.0:1788305285.131217:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788305285.131222:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:11672:x1875173761410176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305285.131318:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:11672:x1875173761410176:12345-0@lo:502:llog_process_th.0 Request processed in 95us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305285.131325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788305285.131353:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0463c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305285.131364:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:16674bd8-0f21-440d-92a6-ff3988850e9b:11672:1875173761410176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305285.131380:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305285.131384:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305285.131390:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788305285.131393:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788305285.131430:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788305285.131442:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305285.131449:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305285.131460:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305285.152586:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305286.001433:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305286.195184:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305287.025322:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305288.049616:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788305288.487869:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1788305288.843389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305288.843436:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305288.843474:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305288.843506:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305288.843542:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452672 00000100:00100000:3.0:1788305288.843552:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452672 00000100:00100000:3.0:1788305288.843608:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452928 00000100:00100000:3.0:1788305288.843612:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452928 00000100:00100000:3.0:1788305288.843638:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:3.0:1788305288.843647:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741452672:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305288.843741:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741452672:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305288.843748:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:3.0:1788305288.843765:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:3.0:1788305288.843772:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741452928:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305288.843809:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2349:x1875173741452928:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305288.843828:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00080000:3.0:1788305288.843845:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305288.844087:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452544 00000100:00100000:0.0:1788305288.844093:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452544 00000100:00100000:0.0:1788305288.844130:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 277 00000100:00100000:0.0:1788305288.844137:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741452544:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305288.844166:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741452544:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 30us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305288.844173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 277 00000100:00100000:1.0:1788305288.844255:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741452800 00000100:00100000:1.0:1788305288.844259:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741452800 00000100:00100000:1.0:1788305288.844301:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1788305288.844308:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741452800:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305288.844335:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741452800:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 29us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305288.844341:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00080000:0.0:1788305288.844393:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305288.945375:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761410560:0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.945452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305288.945530:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788305288.945537:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761410432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.945561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305288.945596:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761410944:0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.945623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305288.945663:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410944 00000100:00100000:0.0:1788305288.945677:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410944 00000100:00100000:0.0:1788305288.945738:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305288.945751:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761410944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.945838:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761410944:12345-0@lo:400:kworker.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305288.945845:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305288.945869:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410560 00000100:00100000:0.0:1788305288.945873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410560 00000100:00100000:0.0:1788305288.945901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410432 00000100:00100000:0.0:1788305288.945904:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410432 00000100:00100000:0.0:1788305288.945923:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305288.945929:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761410560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.945961:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761410560:12345-0@lo:400:kworker.0 Request processed in 32us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305288.945967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305288.945978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305288.945984:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761410432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.946009:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761410432:12345-0@lo:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305288.946015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788305288.946037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305288.946042:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305288.946097:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761410432:0@lo:400:kworker.0 00010000:00080000:0.0:1788305288.946110:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb90f5f480 x1875173761410944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305288.946119:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761410944:0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.946141:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761410560:0@lo:400:kworker.0 00000100:00100000:2.0:1788305288.946396:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761410688:0@lo:400:kworker.0 00000100:00100000:2.0:1788305288.946429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305288.946466:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788305288.946472:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761410304:0@lo:400:kworker.0 00000100:00100000:2.0:1788305288.946496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305288.946522:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761410816:0@lo:400:kworker.0 00000100:00100000:2.0:1788305288.946541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305288.946565:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410816 00000100:00100000:2.0:1788305288.946569:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410816 00000100:00100000:2.0:1788305288.946598:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788305288.946604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761410816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305288.946637:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761410816:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305288.946651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788305288.946668:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305288.946684:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761410816:0@lo:400:kworker.0 00000100:00100000:3.0:1788305288.946746:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410688 00000100:00100000:3.0:1788305288.946750:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410688 00000100:00100000:3.0:1788305288.946806:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305288.946812:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761410688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305288.946852:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761410688:12345-0@lo:400:kworker.0 Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305288.946858:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305288.946882:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788305288.946887:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fb88e38a80, transno 4294967300 00000100:00100000:3.0:1788305288.946898:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761410688:0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.947562:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761410304 00000100:00100000:0.0:1788305288.947569:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761410304 00000100:00100000:0.0:1788305288.947609:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788305288.947616:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761410304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305288.947659:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761410304:12345-0@lo:400:kworker.0 Request processed in 44us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305288.947667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1788305288.947999:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305288.948534:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761410304:0@lo:400:kworker.0 00010000:00010000:0.0:1788305289.073737:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305289.457612:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761411072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305289.457831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305289.457981:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411072 00000100:00100000:3.0:1788305289.457990:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411072 00000100:00100000:3.0:1788305289.458033:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305289.458043:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761411072:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305289.458083:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761411200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305289.458113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305289.458206:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411200 00000100:00100000:0.0:1788305289.458211:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411200 00000100:00100000:0.0:1788305289.458249:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305289.458257:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761411200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305289.458289:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305289.458344:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761411200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305289.458351:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788305289.458430:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fba0598700 x1875173761411200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305289.458457:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761411200:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305289.458701:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305289.458842:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761411072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 800us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305289.458850:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788305289.458960:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761411072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788305290.097641:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305291.121792:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305292.145351:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305293.171737:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305293.961100:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305293.961133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305293.961169:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305293.961209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305293.961240:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453312 00000100:00100000:2.0:1788305293.961249:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453312 00000100:00100000:2.0:1788305293.961308:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:2.0:1788305293.961319:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741453312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305293.961388:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741453312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305293.961396:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1788305293.961399:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453056 00000100:00100000:1.0:1788305293.961405:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453056 00000100:00080000:2.0:1788305293.961420:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305293.961441:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 279 00000100:00100000:1.0:1788305293.961449:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741453056:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305293.961477:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741453056:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305293.961483:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 279 00000100:00100000:3.0:1788305293.961880:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453184 00000100:00100000:3.0:1788305293.961886:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453184 00000100:00100000:3.0:1788305293.961949:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453440 00000100:00100000:3.0:1788305293.961953:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453440 00000100:00100000:1.0:1788305293.962012:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:1.0:1788305293.962021:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741453184:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305293.962077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741453184:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 57us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305293.962084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:3.0:1788305293.962135:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:3.0:1788305293.962145:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741453440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:2.0:1788305293.962212:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305293.962248:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741453440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 105us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305293.962256:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:0.0:1788305294.065510:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761411328:0@lo:400:kworker.0 00000100:00100000:0.0:1788305294.065589:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305294.065736:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411328 00000100:00100000:1.0:1788305294.065759:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411328 00000100:00100000:1.0:1788305294.065817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788305294.065829:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761411328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305294.065935:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761411456:0@lo:400:kworker.0 00000100:00100000:2.0:1788305294.065971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305294.065994:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305294.066000:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761411584:0@lo:400:kworker.0 00000100:00100000:2.0:1788305294.066156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305294.069912:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761411328:12345-0@lo:400:kworker.0 Request processed in 4073us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305294.069928:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788305294.070016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411456 00000100:00100000:1.0:1788305294.070025:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411456 00000100:00100000:1.0:1788305294.070079:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411584 00000100:00100000:1.0:1788305294.070083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411584 00000100:00100000:1.0:1788305294.070114:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788305294.070122:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761411456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305294.070190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761411456:12345-0@lo:400:kworker.0 Request processed in 69us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305294.070197:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788305294.070208:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788305294.070214:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761411584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305294.070238:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761411584:12345-0@lo:400:kworker.0 Request processed in 25us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305294.070244:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1788305294.070260:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305294.070292:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761411584:0@lo:400:kworker.0 00000100:00100000:1.0:1788305294.070303:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761411456:0@lo:400:kworker.0 00000100:00100000:1.0:1788305294.070548:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761411712:0@lo:400:kworker.0 00000100:00100000:1.0:1788305294.072119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305294.072261:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761411328:0@lo:400:kworker.0 00000100:00100000:2.0:1788305294.072893:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411712 00000100:00100000:2.0:1788305294.072901:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411712 00000100:00100000:2.0:1788305294.072974:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305294.072984:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761411712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305294.073049:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761411712:12345-0@lo:400:kworker.0 Request processed in 67us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305294.073078:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788305294.073142:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305294.073192:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761411712:0@lo:400:kworker.0 00000100:00100000:0.0:1788305294.073530:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761411840:0@lo:400:kworker.0 00000100:00100000:0.0:1788305294.073574:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305294.073735:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761411968:0@lo:400:kworker.0 00000100:00100000:2.0:1788305294.073769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305294.074032:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411840 00000100:00100000:1.0:1788305294.074038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411840 00000100:00100000:1.0:1788305294.074102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788305294.074110:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761411840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305294.074156:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761411840:12345-0@lo:400:kworker.0 Request processed in 46us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305294.074163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788305294.074181:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761411840:0@lo:400:kworker.0 00000100:00080000:2.0:1788305294.074242:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305294.074282:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761411968 00000100:00100000:3.0:1788305294.074286:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761411968 00000100:00100000:3.0:1788305294.074329:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305294.074338:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761411968:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788305294.074418:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305294.074450:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761411968:12345-0@lo:400:kworker.0 Request processed in 113us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305294.074457:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788305294.074980:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aaa300 x1875173761411968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305294.074992:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761411968:0@lo:400:kworker.0 00010000:00010000:1.0:1788305294.193297:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305294.577520:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761412224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305294.577600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305294.577746:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305294.577762:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761412096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305294.577796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305294.577845:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412224 00000100:00100000:2.0:1788305294.577853:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412224 00000100:00100000:2.0:1788305294.577898:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412096 00000100:00100000:2.0:1788305294.577901:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412096 00000100:00100000:2.0:1788305294.577918:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788305294.577926:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761412224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305294.577961:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305294.578050:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305294.578086:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761412096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305294.579047:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305294.579250:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761412096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1165us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305294.579259:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305294.582184:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761412096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305294.589369:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761412224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11432us (11758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305294.589401:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788305294.593580:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aa8380 x1875173761412224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305294.593815:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761412224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788305295.220381:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305296.241254:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305296.433765:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305297.265991:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305298.289264:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305299.081621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305299.081708:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305299.083359:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453696 00000100:00100000:0.0:1788305299.083360:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453568 00000100:00100000:2.0:1788305299.083382:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453696 00000100:00100000:0.0:1788305299.083393:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453568 00000100:00080000:1.0:1788305299.083496:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305299.083506:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:0.0:1788305299.083517:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 281 00000100:00100000:2.0:1788305299.083528:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741453696:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305299.083630:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741453696:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 112us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305299.083637:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:0.0:1788305299.083656:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741453568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305299.084032:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741453568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 502us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305299.084040:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 281 00000100:00100000:1.0:1788305299.107335:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305299.107443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305299.107599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453952 00000100:00100000:2.0:1788305299.107619:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453952 00000100:00100000:2.0:1788305299.107694:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:2.0:1788305299.107705:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741453952:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305299.107781:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741453952:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305299.107789:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00080000:1.0:1788305299.107962:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305299.109519:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741453824 00000100:00100000:0.0:1788305299.109531:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741453824 00000100:00080000:1.0:1788305299.109663:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305299.110363:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1788305299.110382:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2346:x1875173741453824:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:0.0:1788305299.110427:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8640 00000100:00080000:0.0:1788305299.110440:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fbbd7f5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305299.110486:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788305299.110787:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+2:2346:x1875173741453824:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 413us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305299.110794:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00010000:00010000:1.0:1788305299.110851:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305299.185344:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305299.185365:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761412480:0@lo:400:kworker.0 00000100:00100000:3.0:1788305299.185456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305299.185544:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761412608:0@lo:400:kworker.0 00000100:00100000:3.0:1788305299.185566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305299.185612:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412480 00000100:00100000:3.0:1788305299.185620:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412480 00000100:00100000:3.0:1788305299.185660:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412608 00000100:00100000:3.0:1788305299.185664:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412608 00000100:00100000:3.0:1788305299.185708:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788305299.185717:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761412480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305299.185918:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788305299.185928:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761412608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305299.185969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761412608:12345-0@lo:400:kworker.0 Request processed in 43us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305299.185976:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788305299.186017:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305299.186115:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761412992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305299.186144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305299.186204:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761412608:0@lo:400:kworker.0 00000100:00100000:2.0:1788305299.186242:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412992 00000100:00100000:2.0:1788305299.186246:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412992 00000100:00100000:2.0:1788305299.186276:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788305299.186283:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761412992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305299.186316:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761412992:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305299.186322:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788305299.186335:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788305299.186353:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc0fcbb80 x1875173761412992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305299.186363:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761412992:0@lo:400:kworker.0 00000100:00100000:3.0:1788305299.186712:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761412480:12345-0@lo:400:kworker.0 Request processed in 994us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305299.186720:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788305299.186801:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761412736:0@lo:400:kworker.0 00000100:00100000:1.0:1788305299.186831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305299.186864:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305299.186871:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761412352:0@lo:400:kworker.0 00000100:00100000:1.0:1788305299.186898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305299.186920:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761412864:0@lo:400:kworker.0 00000100:00100000:1.0:1788305299.186941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305299.186965:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412352 00000100:00100000:1.0:1788305299.186969:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412352 00000100:00100000:1.0:1788305299.186997:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788305299.187003:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761412352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305299.187035:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761412352:12345-0@lo:400:kworker.0 Request processed in 32us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305299.187041:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788305299.187216:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761412352:0@lo:400:kworker.0 00000100:00100000:1.0:1788305299.187233:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412864 00000100:00100000:1.0:1788305299.187236:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412864 00000100:00100000:1.0:1788305299.187264:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788305299.187271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761412864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305299.187304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761412864:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305299.187310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788305299.187322:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305299.187336:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761412864:0@lo:400:kworker.0 00000100:00100000:3.0:1788305299.187538:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761412736 00000100:00100000:3.0:1788305299.187543:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761412736 00000100:00100000:3.0:1788305299.187588:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305299.187595:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761412736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305299.187644:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761412736:12345-0@lo:400:kworker.0 Request processed in 50us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305299.187650:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305299.188289:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761412480:0@lo:400:kworker.0 00000100:00080000:1.0:1788305299.188867:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305299.188906:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761412736:0@lo:400:kworker.0 00010000:00010000:1.0:1788305299.314478:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305299.697563:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761413120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305299.697987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305299.698203:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305299.698214:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761413248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305299.698246:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305299.698283:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413120 00000100:00100000:3.0:1788305299.698290:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413120 00000100:00100000:3.0:1788305299.698327:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413248 00000100:00100000:3.0:1788305299.698331:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413248 00000100:00100000:3.0:1788305299.698349:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305299.698358:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761413120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305299.698407:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305299.698452:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761413120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305299.698630:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305299.698640:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761413248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305299.698660:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305299.698696:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761413248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305299.698702:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305299.698752:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761413120:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788305299.698794:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aaad80 x1875173761413248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305299.698808:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761413248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305299.698934:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:1.0:1788305300.338346:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305301.361341:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305302.385349:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305303.409366:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305303.837986:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:1.0:1788305303.837995:0:6702:0:(genops.c:885:class_export_put()) final put ffff96fbbd7f1800/5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:0.0:1788305303.838042:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbbd7f1800/5455d24f-893c-4899-b5f9-16679e9a93aa for lustre-OST0000 00000020:00000080:0.0:1788305303.838110:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbbd7f5000 for lustre-OST0000 00000100:00100000:1.0:1788305304.200083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305304.200119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305304.200204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305304.200255:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454080 00000100:00100000:3.0:1788305304.200264:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454080 00000100:00100000:3.0:1788305304.200347:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 283 00000100:00100000:3.0:1788305304.200358:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741454080:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305304.200437:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741454080:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 81us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.200445:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 283 00000100:00100000:3.0:1788305304.200572:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454208 00000100:00100000:3.0:1788305304.200577:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454208 00000100:00100000:3.0:1788305304.200648:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454336 00000100:00100000:3.0:1788305304.200652:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454336 00000100:00080000:1.0:1788305304.200673:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305304.200751:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:3.0:1788305304.200759:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741454208:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305304.200791:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741454208:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.200798:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:3.0:1788305304.200811:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:3.0:1788305304.200817:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741454336:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305304.200840:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741454336:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.200847:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:0.0:1788305304.309315:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761413376:0@lo:400:kworker.0 00000100:00100000:0.0:1788305304.309408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305304.309558:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413376 00000100:00100000:1.0:1788305304.309567:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413376 00000100:00100000:1.0:1788305304.309618:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788305304.309628:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761413376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305304.311708:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761413376:12345-0@lo:400:kworker.0 Request processed in 2064us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305304.311723:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788305304.311813:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761413504:0@lo:400:kworker.0 00000100:00100000:1.0:1788305304.311870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305304.311902:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305304.311909:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761413632:0@lo:400:kworker.0 00000100:00100000:1.0:1788305304.311933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305304.321906:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761413760:0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.321994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305304.322393:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305304.322402:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761413888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.322437:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305304.322463:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305304.322471:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761414016:0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.322497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305304.322541:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413504 00000100:00100000:3.0:1788305304.322549:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413504 00000100:00100000:3.0:1788305304.322594:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413632 00000100:00100000:3.0:1788305304.322597:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413632 00000100:00100000:3.0:1788305304.322621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413888 00000100:00100000:3.0:1788305304.322623:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413888 00000100:00100000:3.0:1788305304.322639:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788305304.322661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761413504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.323540:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761413504:12345-0@lo:400:kworker.0 Request processed in 878us (11666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.323549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788305304.323575:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788305304.323586:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761413632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.323626:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761413632:12345-0@lo:400:kworker.0 Request processed in 45us (11692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.323633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788305304.323776:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788305304.323785:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761413888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.323839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761413888:12345-0@lo:400:kworker.0 Request processed in 55us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.323855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788305304.323882:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761413760 00000100:00100000:3.0:1788305304.323888:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761413760 00000100:00100000:3.0:1788305304.323921:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414016 00000100:00100000:3.0:1788305304.323924:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414016 00000100:00100000:3.0:1788305304.323943:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305304.323950:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761413760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.323987:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761413760:12345-0@lo:400:kworker.0 Request processed in 38us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.323993:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305304.324004:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788305304.324011:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761414016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.324048:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761414016:12345-0@lo:400:kworker.0 Request processed in 37us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305304.324071:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788305304.324101:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305304.324105:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305304.324108:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305304.324143:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761413888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.324155:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761413760:0@lo:400:kworker.0 00010000:00080000:3.0:1788305304.324189:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc1aa8380 x1875173761414016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305304.324201:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761414016:0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.324230:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761413632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305304.324247:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761413504:0@lo:400:kworker.0 00000100:00100000:0.0:1788305304.324485:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761413376:0@lo:400:kworker.0 00010000:00010000:1.0:1788305304.434193:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305304.818658:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305304.818676:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305304.818681:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb87090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761414144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305304.818684:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761414272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305304.822020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305304.822387:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414272 00000100:00100000:2.0:1788305304.822397:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414272 00000100:00100000:2.0:1788305304.822449:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305304.822460:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761414272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305304.822497:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305304.822673:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761414272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305304.822681:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788305304.822800:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761414272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305304.824680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305304.825118:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414144 00000100:00100000:0.0:1788305304.825127:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414144 00000100:00100000:0.0:1788305304.825276:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788305304.825286:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761414144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305304.825332:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305304.825391:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761414144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305304.825398:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788305304.825474:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb87090a80 x1875173761414144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305304.825493:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb87090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761414144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788305305.458691:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305306.481309:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305306.676076:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788305306.929138:0:11839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:28:25 (1788305305) 00010000:00010000:3.0:1788305307.511590:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305308.529689:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305308.971882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305308.977180:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454464 00000100:00100000:0.0:1788305308.977204:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454464 00000100:00100000:0.0:1788305308.977693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:0.0:1788305308.977716:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:10226:x1875173741454464:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305308.977744:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305308.977777:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae870b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a430 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305308.977871:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8712 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305308.977901:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305308.977947:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305308.978280:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788305308.978286:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305308.980101:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305308.980169:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae870b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a430 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305308.980202:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a430 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305308.980213:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af300) 00010000:00010000:0.0:1788305308.980217:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305308.980503:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc000, rc 0) 00000100:00100000:0.0:1788305308.980616:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:10226:x1875173741454464:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 2909us (8748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305308.980627:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00080000:3.0:1788305308.983412:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305308.994137:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305308.994391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454592 00000100:00100000:2.0:1788305308.994407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454592 00000100:00100000:2.0:1788305308.994496:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788305308.994510:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:10227:x1875173741454592:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305308.994540:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305308.994572:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a437 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.994671:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.994690:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.994705:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.994721:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.994752:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.994760:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995495:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae872e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae872e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995518:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae872e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305308.995615:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788305308.995620:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305308.995721:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae872e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995735:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995742:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995750:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995757:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7ce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305308.995762:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995777:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995792:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af300) 00010000:00010000:2.0:1788305308.995795:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305308.995802:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995808:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995822:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995828:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995833:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995838:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305308.995840:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995846:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995852:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96fb88992000) 00010000:00010000:2.0:1788305308.995854:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305308.995856:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995871:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8727 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995912:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a437 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995927:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae872e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a437 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305308.995935:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96fb88992200) 00010000:00010000:2.0:1788305308.995938:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305308.995940:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7dc00, rc 0) 00000100:00100000:2.0:1788305308.996042:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:10227:x1875173741454592:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305308.996163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:1.0:1788305308.999675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305308.999848:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454848 00000100:00100000:3.0:1788305308.999863:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454848 00000100:00100000:3.0:1788305308.999942:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1788305308.999956:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:10227:x1875173741454848:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305308.999985:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305309.000012:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8735 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a43e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.010079:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.010117:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.010137:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.010209:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.010217:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.010225:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.013376:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbcc00/0x902a3611c9ae874a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.013405:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbcc00/0x902a3611c9ae874a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.013419:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbcc00/0x902a3611c9ae874a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305309.013445:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788305309.015265:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015284:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015293:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015356:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305309.015362:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015395:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015416:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96fb88992200) 00010000:00010000:3.0:1788305309.015420:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305309.015426:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015443:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae873c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015463:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015470:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015525:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015531:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305309.015534:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015540:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015548:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96fb87f88f00) 00010000:00010000:3.0:1788305309.015550:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305309.015553:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.015570:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8743 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.016543:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8735 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a43e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.016568:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbcc00/0x902a3611c9ae874a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a43e expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305309.016577:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305309.016580:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305309.016583:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbcc00, rc 0) 00000100:00100000:3.0:1788305309.016685:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10227:x1875173741454848:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 16731us (17024us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788305309.016694:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:1.0:1788305309.020361:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305309.020674:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741454976 00000100:00100000:2.0:1788305309.020698:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741454976 00000100:00100000:2.0:1788305309.020840:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1788305309.020863:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10227:x1875173741454976:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788305309.021119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10227:x1875173741454976:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 267us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305309.021146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1788305309.333620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305309.333687:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305309.333888:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741455104 00000100:00100000:3.0:1788305309.333902:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741455104 00000100:00100000:3.0:1788305309.333980:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 285 00000100:00100000:3.0:1788305309.333992:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741455104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305309.334117:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741455104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 127us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305309.334127:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 285 00000100:00100000:0.0:1788305309.334800:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741455232 00000100:00100000:0.0:1788305309.334807:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741455232 00000100:00100000:0.0:1788305309.334884:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:0.0:1788305309.334900:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741455232:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305309.334958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741455232:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 65us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305309.334966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00080000:1.0:1788305309.335415:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305309.425263:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761414400:0@lo:400:kworker.0 00000100:00100000:3.0:1788305309.425372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305309.425421:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414400 00000100:00100000:0.0:1788305309.425440:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414400 00000100:00100000:0.0:1788305309.425521:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788305309.425535:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761414400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425618:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761414784:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305309.425699:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761414656:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305309.425746:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305309.425749:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761414528:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305309.425782:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414784 00000100:00100000:2.0:1788305309.425785:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414784 00000100:00100000:2.0:1788305309.425818:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305309.425823:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761414784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425849:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761414784:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305309.425854:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305309.425875:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414656 00000100:00100000:2.0:1788305309.425878:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414656 00000100:00100000:2.0:1788305309.425895:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414528 00000100:00100000:2.0:1788305309.425897:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414528 00000100:00100000:2.0:1788305309.425909:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788305309.425913:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761414656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425934:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761414656:12345-0@lo:400:kworker.0 Request processed in 21us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305309.425938:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788305309.425945:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788305309.425948:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761414528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.425962:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761414528:12345-0@lo:400:kworker.0 Request processed in 14us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305309.425965:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788305309.425980:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305309.425984:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305309.426024:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761414784:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.426044:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761414528:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.426049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761414656:0@lo:400:kworker.0 00000100:00100000:0.0:1788305309.427798:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761414400:12345-0@lo:400:kworker.0 Request processed in 2255us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305309.427814:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788305309.432507:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761414400:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.434377:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305309.434407:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761414912:0@lo:400:kworker.0 00000100:00100000:1.0:1788305309.434512:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761415040:0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.434517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305309.434581:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761414912 00000100:00100000:2.0:1788305309.434590:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761414912 00000100:00100000:2.0:1788305309.434669:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788305309.434679:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761414912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305309.434742:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761414912:12345-0@lo:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305309.434750:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788305309.434777:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305309.434812:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761414912:0@lo:400:kworker.0 00000100:00100000:1.0:1788305309.437502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305309.437554:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761415040 00000100:00100000:0.0:1788305309.437565:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761415040 00000100:00100000:0.0:1788305309.437658:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788305309.437675:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761415040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305309.437743:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761415040:12345-0@lo:400:kworker.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305309.437751:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788305309.437853:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788305309.437905:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc16af100 x1875173761415040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305309.437923:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761415040:0@lo:400:kworker.0 00010000:00010000:3.0:1788305309.553239:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305309.746023:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305309.938541:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305309.938573:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761415168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305309.938669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305309.938758:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761415168 00000100:00100000:1.0:1788305309.938767:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761415168 00000100:00100000:1.0:1788305309.938835:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305309.938846:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761415168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305309.938892:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305309.938946:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761415168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305309.938953:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788305309.939000:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fbc16af100 x1875173761415168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305309.939023:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761415168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305309.942693:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761415296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305309.942790:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305309.942895:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761415296 00000100:00100000:1.0:1788305309.942905:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761415296 00000100:00100000:1.0:1788305309.942962:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305309.942973:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761415296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305309.943021:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305309.943100:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761415296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305309.943109:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305309.943170:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761415296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788305310.577323:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305311.024022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.024151:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741455360 00000100:00100000:2.0:1788305311.024164:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741455360 00000100:00100000:2.0:1788305311.024274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1788305311.024289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10270:x1875173741455360:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305311.024318:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305311.024358:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a445 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024455:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024493:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024508:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024528:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024536:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024543:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024879:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024888:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024896:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024904:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305311.024909:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024917:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024933:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af300) 00010000:00010000:2.0:1788305311.024942:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305311.024949:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024956:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae875f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024969:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024975:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024982:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024987:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7ce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305311.024990:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.024997:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.025005:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96fb88992000) 00010000:00010000:2.0:1788305311.025008:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305311.025011:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.025017:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae8766 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.025084:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8758 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a445 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.025105:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af300) 00010000:00010000:2.0:1788305311.025107:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305311.025112:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a445 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.025122:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ca00, rc 0) 00000100:00100000:2.0:1788305311.025202:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10270:x1875173741455360:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 916us (1196us total) trans 0 rc 301/301 00000100:00100000:2.0:1788305311.025210:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00080000:3.0:1788305311.025713:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305311.033796:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305311.033893:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741455616 00000100:00100000:3.0:1788305311.033907:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741455616 00000100:00100000:3.0:1788305311.033983:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:3.0:1788305311.033996:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10270:x1875173741455616:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:3.0:1788305311.034106:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305311.034141:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8712 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a430 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.034179:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af300) 00010000:00010000:3.0:1788305311.034192:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305311.034566:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.034583:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.034596:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.034612:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.034619:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.034627:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305311.035708:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788305311.035728:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.035738:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.035745:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.035752:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305311.035756:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.035764:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.035778:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:3.0:1788305311.035782:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305311.035787:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.035793:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae876d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305311.035810:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d839e32 reply state 000000004fb33ffb transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305311.035820:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305311.035959:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+10:10270:x1875173741455616:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 1963us (2174us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788305311.035979:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00010000:00010000:3.0:1788305311.044341:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.044362:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.044372:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.044380:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbdc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305311.044386:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.044405:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.044427:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96fb87f88700) 00010000:00010000:3.0:1788305311.044430:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305311.044436:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.044443:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8774 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305311.138838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.138997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741455744 00000100:00100000:0.0:1788305311.139011:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741455744 00000100:00100000:0.0:1788305311.139104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1788305311.139118:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:10278:x1875173741455744:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:0.0:1788305311.139150:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.139181:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae877b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a44c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.139341:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.139358:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.139370:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.139472:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788305311.139477:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305311.139527:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.139560:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae877b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a44c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.140712:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a44c expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.140728:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:0.0:1788305311.140732:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305311.140736:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fda00, rc 0) 00000100:00100000:0.0:1788305311.140823:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:10278:x1875173741455744:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 1708us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.140833:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:1.0:1788305311.213377:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305311.213467:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741455872 00000100:00100000:3.0:1788305311.213479:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741455872 00000100:00100000:3.0:1788305311.213551:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1788305311.213565:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+10:10284:x1875173741455872:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305311.213594:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305311.213651:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a453 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.213753:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.213772:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.213787:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.213996:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.214003:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.214008:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214255:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae879e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214265:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae879e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214273:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae879e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305311.214315:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788305311.214319:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305311.214367:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae879e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214382:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214388:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214420:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214426:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305311.214431:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214439:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214452:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:2.0:1788305311.214455:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305311.214460:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214466:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214482:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214488:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214493:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214498:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305311.214501:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214517:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214524:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96fb87f88900) 00010000:00010000:2.0:1788305311.214526:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305311.214529:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214534:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214783:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a453 expref: 12 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214800:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae879e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a453 expref: 11 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.214808:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305311.214811:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788305311.214813:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ce00, rc 0) 00000100:00100000:2.0:1788305311.214906:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+11:10284:x1875173741455872:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1344us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305311.214915:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:1.0:1788305311.217954:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.218178:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741456128 00000100:00100000:0.0:1788305311.218193:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741456128 00000100:00100000:0.0:1788305311.218304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:0.0:1788305311.218317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+11:10284:x1875173741456128:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305311.218346:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.218372:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a45a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.218583:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.218617:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.218631:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.220424:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.220461:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.220476:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305311.221711:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788305311.222138:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222154:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222166:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222204:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222210:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222217:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222232:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.222237:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222244:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222257:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305311.222259:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305311.222263:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222268:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305311.222282:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085819187 reply state 00000000e62b3a60 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.222290:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788305311.222324:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222336:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.222343:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305311.222345:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305311.222348:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc400, rc 0) 00000100:00100000:0.0:1788305311.222445:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10284:x1875173741456128:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4130us (4505us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788305311.222466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00010000:00010000:3.0:1788305311.224290:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.224305:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.224311:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.224317:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305311.224321:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.224345:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.224361:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21af700) 00010000:00010000:3.0:1788305311.224364:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305311.224368:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.224385:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae87b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305311.226499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.229368:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741456256 00000100:00100000:2.0:1788305311.229525:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741456256 00000100:00100000:2.0:1788305311.229637:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788305311.229646:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875173741456256:12345-192.168.201.38@tcp:8:bash.0 00010000:00080000:2.0:1788305311.229679:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:2.0:1788305311.229727:0:6678:0:(genops.c:1385:class_connect()) connect: client 5455d24f-893c-4899-b5f9-16679e9a93aa, cookie 0x902a3611c9ae87c8 00002000:00100000:2.0:1788305311.229739:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5455d24f-893c-4899-b5f9-16679e9a93aa/ffff96fb880c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305311.229749:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305311.230015:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305311.230046:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fb880cb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305311.230145:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2346:x1875173741456256:12345-192.168.201.38@tcp:8:bash.0 Request processed in 497us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305311.230153:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305311.239979:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.240386:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741456384 00000100:00100000:2.0:1788305311.240407:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741456384 00000100:00100000:2.0:1788305311.240487:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:2.0:1788305311.240498:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:0:x1875173741456384:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788305311.240516:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305311.240542:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a461 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305311.240572:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788305311.240592:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788305311.240598:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305311.240666:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.240690:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.240704:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c200, rc 0) 00000100:00100000:2.0:1788305311.240781:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:0:x1875173741456384:12345-192.168.201.38@tcp:101:bash.0 Request processed in 285us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305311.240788:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00080000:3.0:1788305311.241983:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305311.250460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.250549:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741456512 00000100:00100000:2.0:1788305311.250559:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741456512 00000100:00100000:1.0:1788305311.250635:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:1.0:1788305311.250649:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:10284:x1875173741456512:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305311.250667:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305311.250688:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a468 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.250718:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.250745:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305311.250749:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305311.250755:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.250858:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.250873:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305311.250950:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875173761415424:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305311.251248:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb4109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305311.254433:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875173761415424:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305311.254542:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.254566:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f000, rc 0) 00000100:00100000:2.0:1788305311.254708:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:10284:x1875173741456512:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4062us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305311.254718:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788305311.263746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.263871:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741456640 00000100:00100000:0.0:1788305311.263881:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741456640 00010000:00010000:0.0:1788305311.264242:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.264318:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:0.0:1788305311.264329:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741456640:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305311.264344:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305311.264366:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.264381:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.264421:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9f57fe2/0x902a3611c9ae87cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a461 expref: 8 pid: 6677 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.264439:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305311.264443:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305311.264451:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.264462:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.264515:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.264528:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875173761415552:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788305311.264605:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba04639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305311.271265:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875173761415552:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788305311.271288:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305311.271316:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305311.271403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741456896 00000100:00100000:1.0:1788305311.271409:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741456896 00000100:00100000:1.0:1788305311.271457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305311.271466:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10284:x1875173741456896:12345-192.168.201.38@tcp:35:bash.0 00000001:00080000:1.0:1788305311.271714:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:1.0:1788305311.271806:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:10284:x1875173741456896:12345-192.168.201.38@tcp:35:bash.0 Request processed in 339us (492us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788305311.271813:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000020:00080000:1.0:1788305311.271818:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788305311.272027:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741456640:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 7699us (8290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.272036:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1788305311.380552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.380682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741457152 00000100:00100000:0.0:1788305311.380696:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741457152 00000100:00100000:0.0:1788305311.380776:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:0.0:1788305311.380789:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+15:10294:x1875173741457152:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305311.380830:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.380859:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a46f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.381016:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788305311.381199:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a46f expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.381217:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:0.0:1788305311.381220:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305311.381242:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a46f expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.381262:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd400, rc 0) 00000100:00100000:0.0:1788305311.381341:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+16:10294:x1875173741457152:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 555us (805us total) trans 4294967314 rc 301/301 00000100:00100000:0.0:1788305311.381349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:2.0:1788305311.389272:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305311.389387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741457408 00000100:00100000:1.0:1788305311.389406:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741457408 00000100:00100000:1.0:1788305311.389472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788305311.389497:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+16:10294:x1875173741457408:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788305311.389766:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+17:10294:x1875173741457408:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 270us (504us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788305311.389774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788305311.478973:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.479106:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741457536 00000100:00100000:0.0:1788305311.479121:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741457536 00000100:00100000:0.0:1788305311.479237:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:0.0:1788305311.479262:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+17:10300:x1875173741457536:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305311.479297:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.479325:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a476 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.479434:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.479451:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.479467:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.479550:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1788305311.479555:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305311.479582:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.480538:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae87eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a476 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.480592:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a476 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.480615:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305311.480620:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305311.480625:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd800, rc 0) 00000100:00100000:0.0:1788305311.480720:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10300:x1875173741457536:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1461us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.480729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788305311.488472:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.488548:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741457792 00000100:00100000:2.0:1788305311.488563:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741457792 00000100:00100000:2.0:1788305311.488741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788305311.488754:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10300:x1875173741457792:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305311.488773:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305311.488792:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae87f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a47d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.488871:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.488895:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.488903:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305311.488912:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788305311.489014:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae87f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a47d expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.489028:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a47d expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.489035:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305311.489037:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305311.489039:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ca00, rc 0) 00000100:00100000:2.0:1788305311.489121:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10300:x1875173741457792:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 371us (666us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788305311.489126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788305311.494857:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.494974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.495785:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741458176 00000100:00100000:0.0:1788305311.495796:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741458176 00000100:00100000:0.0:1788305311.495848:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:0.0:1788305311.495859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10300:x1875173741458176:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305311.495882:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.495903:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae880e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a484 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.495996:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8815 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.496011:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.496023:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.496036:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788305311.496188:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae880e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a484 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.496209:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8815 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a484 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.496217:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305311.496220:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788305311.496224:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc000, rc 0) 00000100:00100000:0.0:1788305311.496282:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+22:10300:x1875173741458176:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 425us (1311us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788305311.496287:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1788305311.498767:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741457920 00000100:00100000:1.0:1788305311.498781:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741457920 00000100:00100000:1.0:1788305311.498848:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:1.0:1788305311.498857:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:2348:x1875173741457920:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305311.498872:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305311.498894:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a47d expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.498912:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305311.498917:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305311.499501:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:2348:x1875173741457920:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 643us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305311.499509:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1788305311.508616:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.508717:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741458304 00000100:00100000:0.0:1788305311.508731:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741458304 00000100:00100000:0.0:1788305311.508811:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1788305311.508827:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741458304:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:0.0:1788305311.508892:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.508919:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.508931:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788305311.508937:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305311.508943:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.508994:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.509025:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 7 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.509045:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875173761415680:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305311.509221:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305311.514868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.514924:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875173761415680:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305311.514950:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305311.514999:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741458432 00000100:00100000:2.0:1788305311.515004:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741458432 00002000:00100000:2.0:1788305311.515043:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff96fbc0fc8380 x1875173741458432/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:242/0 lens 504/0 e 0 to 0 dl 1788305322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305311.515085:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc0fc8380 with x1875173741458432 ext(0->12) 00010000:00010000:2.0:1788305311.515094:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 8 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.515109:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 8 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305311.515118:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96fbc0fc8380 00000100:00100000:2.0:1788305311.515144:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:2.0:1788305311.515152:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741458432:12345-192.168.201.38@tcp:4:lfs.0 00000001:00100000:2.0:1788305311.519940:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000100:00100000:3.0:1788305311.539899:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741458432:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 24733us (25027us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788305311.539918:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00002000:00100000:3.0:1788305311.539930:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff96fbc0fc8380 x1875173741458432/t4294967299(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:242/0 lens 504/448 e 0 to 0 dl 1788305322 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305311.539940:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc0fc8380 with x1875173741458432 ext(0->12) 00010000:00010000:3.0:1788305311.539951:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 9 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305311.539968:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 9 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305311.539976:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96fbc0fc8380 00000100:00100000:2.0:1788305311.550544:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305311.550838:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741458560 00000100:00100000:1.0:1788305311.550848:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741458560 00010000:00010000:1.0:1788305311.550899:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 9 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305311.550942:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:1.0:1788305311.550952:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2348:x1875173741458560:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305311.550967:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788305311.550986:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788305311.550999:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788305311 00002000:00010000:1.0:1788305311.551001:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788305311 00002000:00010000:1.0:1788305311.551003:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788305311 00010000:00010000:1.0:1788305311.551010:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 9 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.551025:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 9 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.551049:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae87d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a468 expref: 9 pid: 6677 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.551273:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305311.551277:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305311.551284:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.551294:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.551709:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305311.551774:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741458560:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 822us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305311.551782:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00010000:00010000:0.0:1788305311.552508:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552521:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552551:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552560:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552568:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552576:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305311.552580:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552663:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552680:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.552687:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000121bf25a/0x902a3611c9ae8823 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.552799:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741458304:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 43975us (44196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.552809:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1788305311.563462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305311.563652:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741458816 00000100:00100000:1.0:1788305311.563665:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741458816 00000100:00100000:1.0:1788305311.563719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305311.563730:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+21:10300:x1875173741458816:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1788305311.563796:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8815 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a484 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305311.564100:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788305311.564141:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788305311.566147:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:0.0:1788305311.566230:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.566249:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.566258:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.566295:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.566311:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 25 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.566339:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875173761415808:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305311.566467:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305311.577162:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.577373:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875173761415808:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305311.577419:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305311.577518:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741458944 00000100:00100000:1.0:1788305311.577526:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741458944 00010000:00010000:1.0:1788305311.577578:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 26 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305311.577620:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:1.0:1788305311.577631:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+26:2348:x1875173741458944:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305311.577646:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305311.577654:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 26 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.577667:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 26 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.577690:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae87ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a45a expref: 26 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.577707:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305311.577712:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.577721:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.577729:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.577773:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305311.577832:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+25:2348:x1875173741458944:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 201us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305311.577840:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00010000:00010000:2.0:1788305311.578696:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305311.578720:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305311.578848:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1788305311.579280:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788305311.579407:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fc9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761415936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305311.579699:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305311.579741:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb6140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305311.579833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761415936 00000100:00100000:3.0:1788305311.579841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761415936 00000100:00100000:3.0:1788305311.579916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305311.579926:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875173761415936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788305311.580010:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875173761415936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305311.580018:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305311.580115:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fc9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761415936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788305311.581042:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788305311.581137:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761416064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788305311.581190:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305311.581221:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305311.581308:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761416064 00000100:00100000:0.0:1788305311.581314:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761416064 00000100:00100000:0.0:1788305311.581339:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305311.581346:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875173761416064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788305311.581538:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875173761416064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 191us (348us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788305311.581545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305311.581735:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761416064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788305311.581781:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788305311.581817:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.581829:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.581836:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.581842:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305311.581847:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.581854:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.581869:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305311.581879:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788305311.581885:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305311.581891:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae882a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305311.582100:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788305311.582306:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788305311.582317:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329292263011ns, next at 330292260904ns, rc = 0 00000001:00080000:1.0:1788305311.582324:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788305311.582356:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305311.582359:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788305311.582367:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8815 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a484 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788305311.582731:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305311.582932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+28:10300:x1875173741458816:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 19201us (19478us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788305311.582943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000020:00080000:1.0:1788305311.582948:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788305311.600474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.600634:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741459072 00000100:00100000:0.0:1788305311.600645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741459072 00000100:00100000:0.0:1788305311.600710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:0.0:1788305311.600723:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+28:10300:x1875173741459072:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305311.600749:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.600774:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a48b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.600833:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a48b expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.600848:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a48b expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.600883:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305311.600887:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305311.600891:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd200, rc 0) 00000100:00100000:0.0:1788305311.600952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+29:10300:x1875173741459072:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 232us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.600959:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00010000:00010000:3.0:1788305311.601594:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305311.608750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.608845:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741459328 00000100:00100000:2.0:1788305311.608856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741459328 00000100:00100000:2.0:1788305311.608949:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1788305311.608960:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0321850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+29:10300:x1875173741459328:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305311.609240:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0321850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+30:10300:x1875173741459328:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 268us (486us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788305311.609249:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788305311.666179:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.666317:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741459584 00000100:00100000:0.0:1788305311.666334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741459584 00000100:00100000:0.0:1788305311.666443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:0.0:1788305311.666455:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:10310:x1875173741459584:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305311.666482:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.666505:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a492 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.666619:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788305311.666738:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8838 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a492 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.666753:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:0.0:1788305311.666756:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305311.666761:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a492 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.666778:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc000, rc 0) 00000100:00100000:0.0:1788305311.666847:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+31:10310:x1875173741459584:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 394us (681us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1788305311.666874:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1788305311.668888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.669008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741459712 00000100:00100000:0.0:1788305311.669020:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741459712 00000100:00100000:0.0:1788305311.669180:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1788305311.669193:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+31:10310:x1875173741459712:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788305311.669304:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669324:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669338:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669356:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669364:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669371:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669508:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669518:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669526:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305311.669611:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669627:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669634:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669642:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669648:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.669654:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669663:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669678:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305311.669681:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305311.669687:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669694:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8846 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669714:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669721:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669734:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669739:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.669742:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669749:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669758:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21af800) 00010000:00010000:0.0:1788305311.669760:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305311.669763:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669769:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae884d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669788:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669795:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669802:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669807:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.669810:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669825:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669834:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305311.669836:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305311.669839:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.669845:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8854 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.669940:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+31:10310:x1875173741459712:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 749us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.669949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788305311.673711:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305311.673798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741459968 00000100:00100000:1.0:1788305311.673812:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741459968 00000100:00100000:1.0:1788305311.673885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1788305311.673898:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+31:10310:x1875173741459968:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788305311.674304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+32:10310:x1875173741459968:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 406us (602us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788305311.674313:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1788305311.697502:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.697829:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741460224 00000100:00100000:0.0:1788305311.697842:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741460224 00000100:00100000:0.0:1788305311.697901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788305311.697918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+32:10313:x1875173741460224:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305311.697948:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.697971:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae885b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a499 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698049:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698091:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698106:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698138:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698147:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698155:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698317:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698326:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698334:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.698345:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788305311.698488:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698497:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698503:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698509:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490e00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.698515:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698534:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698549:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305311.698553:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305311.698559:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698566:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8862 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698586:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.698591:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699042:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699109:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.699114:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699121:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699132:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21af800) 00010000:00010000:0.0:1788305311.699135:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305311.699138:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699155:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699219:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae885b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699235:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.699244:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305311.699247:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305311.699250:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81491a00, rc 0) 00000100:00100000:0.0:1788305311.699399:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10313:x1875173741460224:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1488us (1908us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788305311.699409:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1788305311.702166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.702252:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741460352 00000100:00100000:0.0:1788305311.702264:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741460352 00000100:00100000:0.0:1788305311.702337:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:0.0:1788305311.702349:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10313:x1875173741460352:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788305311.702456:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702476:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702489:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702543:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702550:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702557:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702563:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305311.702568:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702576:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702591:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305311.702594:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305311.702612:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.702620:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae887e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305311.703268:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10313:x1875173741460352:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 915us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.703280:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788305311.705540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305311.705638:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741460608 00000100:00100000:2.0:1788305311.705650:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741460608 00000100:00100000:2.0:1788305311.705756:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305311.705769:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10313:x1875173741460608:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305311.706092:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+35:10313:x1875173741460608:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 324us (565us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788305311.706102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305311.972140:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.972457:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741460864 00000100:00100000:0.0:1788305311.972472:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741460864 00000100:00100000:0.0:1788305311.972602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788305311.972637:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+35:10344:x1875173741460864:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788305311.972672:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305311.972699:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.972846:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae888c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.972865:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae888c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.972878:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae888c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305311.972892:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788305311.973104:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a0 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.973130:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae888c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a0 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.973140:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305311.973144:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305311.973148:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd400, rc 0) 00000100:00100000:0.0:1788305311.973298:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:10344:x1875173741460864:12345-192.168.201.38@tcp:101:cat.0 Request processed in 665us (1173us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788305311.973306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1788305311.983976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305311.984149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741461120 00000100:00100000:3.0:1788305311.984162:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741461120 00000100:00100000:3.0:1788305311.984235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:3.0:1788305311.984248:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:10344:x1875173741461120:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:3.0:1788305311.984622:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+38:10344:x1875173741461120:12345-192.168.201.38@tcp:35:cat.0 Request processed in 375us (662us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788305311.984631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788305311.986870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305311.987047:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741461248 00000100:00100000:0.0:1788305311.987085:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741461248 00000100:00100000:0.0:1788305311.987195:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788305311.987206:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83072450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+38:2348:x1875173741461248:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305311.987221:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305311.987257:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae888c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a0 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305311.987277:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305311.987282:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305311.987344:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83072450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+37:2348:x1875173741461248:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 140us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305311.987351:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788305312.082752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305312.083474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741461504 00000100:00100000:1.0:1788305312.083498:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741461504 00000100:00100000:1.0:1788305312.083568:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1788305312.083578:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+37:10350:x1875173741461504:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:1.0:1788305312.083820:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305312.083824:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788305312.083853:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae87f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a476 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.083874:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:1.0:1788305312.083879:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305312.083892:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae889a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4a7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.083998:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.084012:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.084021:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.084092:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.084108:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 37 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305312.084122:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761416192:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305312.084724:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788305312.100833:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.100923:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761416192:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305312.100948:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305312.101010:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741461632 00000100:00100000:2.0:1788305312.101016:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741461632 00010000:00010000:2.0:1788305312.101076:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 38 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305312.101107:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:2.0:1788305312.101114:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+38:2347:x1875173741461632:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305312.101126:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305312.101133:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 38 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.101146:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 38 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.101167:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a499 expref: 38 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.101184:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305312.101189:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.101197:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.101204:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.101232:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305312.101282:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:2347:x1875173741461632:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 168us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305312.101300:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00010000:00010000:1.0:1788305312.101359:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.101368:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305312.101397:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788305312.101563:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae889a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.101579:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.101587:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305312.101590:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305312.101593:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ee00, rc 0) 00000100:00100000:1.0:1788305312.101618:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+37:10350:x1875173741461504:12345-192.168.201.38@tcp:101:dd.0 Request processed in 18042us (18875us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788305312.101640:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1788305312.107908:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.108198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741461888 00000100:00100000:0.0:1788305312.108212:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741461888 00000100:00100000:0.0:1788305312.108291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:0.0:1788305312.108301:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+37:10350:x1875173741461888:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:0.0:1788305312.108584:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.108602:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.108613:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305312.108695:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:0.0:1788305312.108719:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d66ee541 reply state 00000000bf95dce1 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305312.108728:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305312.108834:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+40:10350:x1875173741461888:12345-192.168.201.38@tcp:36:dd.0 Request processed in 533us (941us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788305312.108842:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000020:00080000:0.0:1788305312.108847:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788305312.113608:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.113633:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.113643:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.113677:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305312.113684:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.113693:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.113717:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305312.113721:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305312.113728:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.113736:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305312.465953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.466263:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741462016 00000100:00100000:0.0:1788305312.466274:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741462016 00000100:00100000:0.0:1788305312.466340:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1788305312.466350:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+39:10364:x1875173741462016:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:0.0:1788305312.466386:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305312.466410:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4ae expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466482:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466495:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466508:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466521:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466555:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466562:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466816:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466827:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466835:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466873:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.466885:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 40 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305312.466898:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761416320:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305312.467142:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305312.471139:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305312.471822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741462272 00000100:00100000:2.0:1788305312.471831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741462272 00000100:00100000:2.0:1788305312.471892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1788305312.471902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+41:5587:x1875173741462272:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788305312.472477:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+42:5587:x1875173741462272:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 574us (1345us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788305312.472486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788305312.473150:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761416320:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305312.473179:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305312.480599:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305312.480901:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741462400 00000100:00100000:2.0:1788305312.480912:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741462400 00010000:00010000:2.0:1788305312.480953:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 42 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305312.481000:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788305312.481020:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+42:2347:x1875173741462400:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305312.481034:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305312.481041:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 42 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.481098:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 42 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.481121:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae88a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4a7 expref: 42 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.481140:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305312.481159:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.481169:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.481177:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.481206:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305312.481271:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+41:2347:x1875173741462400:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 252us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305312.481280:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00010000:00010000:1.0:1788305312.482246:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482261:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305312.482313:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788305312.482318:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305312.482360:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482386:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482396:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482414:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482421:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482428:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305312.482433:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482441:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482455:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:1.0:1788305312.482458:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305312.482462:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482467:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482484:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482489:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482495:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482499:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305312.482508:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482513:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482522:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21af800) 00010000:00010000:1.0:1788305312.482524:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305312.482527:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482533:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482574:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ae expref: 41 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482589:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ae expref: 40 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.482609:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305312.482612:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305312.482614:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc400, rc 0) 00000100:00100000:1.0:1788305312.482675:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+40:10364:x1875173741462016:12345-192.168.201.38@tcp:101:stat.0 Request processed in 16325us (16731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305312.482682:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1788305312.599220:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.599461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741462656 00000100:00100000:0.0:1788305312.599486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741462656 00000100:00100000:0.0:1788305312.599559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:0.0:1788305312.599570:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+40:10370:x1875173741462656:12345-192.168.201.38@tcp:36:truncate.0 00010000:00010000:0.0:1788305312.599641:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305312.599670:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ae expref: 40 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.599693:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305312.599699:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305312.599891:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.599905:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.599915:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305312.599963:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:0.0:1788305312.599985:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001786ff99 reply state 0000000093ff344e transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305312.599994:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305312.600196:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+42:10370:x1875173741462656:12345-192.168.201.38@tcp:36:truncate.0 Request processed in 627us (986us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788305312.600204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000020:00080000:0.0:1788305312.600210:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788305312.605340:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.605386:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.605393:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.605399:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305312.605403:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.605410:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.605428:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305312.605431:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305312.605435:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.605440:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.627511:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305312.752155:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.752269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741462784 00000100:00100000:0.0:1788305312.752279:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741462784 00000100:00100000:0.0:1788305312.752339:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1788305312.752380:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+41:10384:x1875173741462784:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:0.0:1788305312.752405:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305312.752426:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4b5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752492:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752506:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752514:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752631:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752640:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752645:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752724:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752730:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752734:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305312.752773:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788305312.752777:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305312.752794:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752802:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752808:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752812:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752816:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752819:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305312.752822:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752827:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752835:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305312.752837:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305312.752840:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752844:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae88e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752864:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752868:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752871:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752874:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305312.752876:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752879:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752883:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21af900) 00010000:00010000:0.0:1788305312.752884:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305312.752885:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752888:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae88e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752909:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752917:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.752928:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305312.752930:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305312.752932:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc000, rc 0) 00000100:00100000:0.0:1788305312.752983:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+42:10384:x1875173741462784:12345-192.168.201.38@tcp:101:stat.0 Request processed in 620us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305312.752989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1788305312.845306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.845488:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741463040 00000100:00100000:0.0:1788305312.845498:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741463040 00000100:00100000:0.0:1788305312.845562:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:0.0:1788305312.845573:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+42:10394:x1875173741463040:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305312.845604:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305312.845627:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305312.845739:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788305312.845860:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4bc expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.845874:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:0.0:1788305312.845877:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305312.845883:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae88f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4bc expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.845899:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc400, rc 0) 00000100:00100000:0.0:1788305312.845960:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+43:10394:x1875173741463040:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 389us (665us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1788305312.845984:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:3.0:1788305312.849871:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305312.849978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741463296 00000100:00100000:1.0:1788305312.850004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741463296 00000100:00100000:2.0:1788305312.850283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1788305312.850297:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+43:10394:x1875173741463296:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305312.850569:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+44:10394:x1875173741463296:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 275us (708us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788305312.850577:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1788305312.926850:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305312.926958:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741463552 00000100:00100000:0.0:1788305312.926969:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741463552 00000100:00100000:0.0:1788305312.927094:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1788305312.927105:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+44:10400:x1875173741463552:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305312.927129:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305312.927152:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8903 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4c3 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.927266:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.927282:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.927291:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.927327:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.927340:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 45 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305312.927354:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761416448:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305312.927515:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305312.932889:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305312.932941:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741463680 00000100:00100000:3.0:1788305312.932950:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741463680 00010000:00010000:3.0:1788305312.932990:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 46 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305312.933023:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:3.0:1788305312.933033:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+46:2347:x1875173741463680:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305312.933103:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305312.933112:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 46 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.933127:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 46 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.933149:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305312.933154:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.933164:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.933172:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305312.933193:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305312.933262:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+46:2347:x1875173741463680:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 229us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305312.933270:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00010000:00010000:2.0:1788305312.934109:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae88ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4b5 expref: 45 pid: 5834 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305312.934131:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761416448:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305312.934155:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.934165:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.934187:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305312.934207:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788305312.934383:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8903 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 46 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.934400:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 45 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.934408:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305312.934411:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305312.934414:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd800, rc 0) 00000100:00100000:2.0:1788305312.934510:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+45:10400:x1875173741463552:12345-192.168.201.38@tcp:101:bash.0 Request processed in 7407us (7671us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788305312.934518:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1788305312.938951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305312.939030:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741463936 00000100:00100000:1.0:1788305312.939042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741463936 00000100:00100000:1.0:1788305312.939142:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:1.0:1788305312.939153:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+45:10400:x1875173741463936:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:1.0:1788305312.939446:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.939463:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.939472:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305312.939523:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:1.0:1788305312.939548:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089938a9e reply state 00000000630c9727 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305312.939558:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305312.940349:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10400:x1875173741463936:12345-192.168.201.38@tcp:36:bash.0 Request processed in 1192us (1403us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788305312.940357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000020:00080000:1.0:1788305312.940372:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788305312.945244:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305312.945547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741464064 00000100:00100000:1.0:1788305312.945558:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741464064 00000100:00100000:1.0:1788305312.945629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:1.0:1788305312.945639:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10400:x1875173741464064:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305312.945664:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305312.945684:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae891f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4ca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945777:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945791:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945800:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945806:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945823:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945847:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.945861:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305312.945875:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761416576:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305312.945945:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5240 going to sleep for 11 seconds 00010000:00010000:0.0:1788305312.946320:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946335:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946342:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946349:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305312.946353:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946360:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946386:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305312.946389:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305312.946392:0:3288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946400:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305312.946405:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8918 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305312.951524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305312.951641:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761416576:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305312.951669:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305312.951787:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741464192 00000100:00100000:2.0:1788305312.951794:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741464192 00010000:00010000:2.0:1788305312.951829:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305312.951866:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:2.0:1788305312.951875:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+49:2348:x1875173741464192:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305312.951890:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305312.951897:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.951926:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.951948:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae890a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4c3 expref: 49 pid: 8201 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.951967:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305312.951972:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.951981:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.951989:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305312.952016:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305312.952115:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+48:2348:x1875173741464192:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 240us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305312.952122:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00010000:00010000:1.0:1788305312.952348:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.952373:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305312.952423:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788305312.952428:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305312.952448:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.952478:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae891f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ca expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.952493:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ca expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305312.952501:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305312.952503:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305312.952506:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f200, rc 0) 00000100:00100000:1.0:1788305312.952533:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+47:10400:x1875173741464064:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6896us (7299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305312.952539:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:2.0:1788305312.956463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305312.956553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741464448 00000100:00100000:3.0:1788305312.956563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741464448 00000100:00100000:3.0:1788305312.956629:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788305312.956639:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0322c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+47:10400:x1875173741464448:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1788305312.956894:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0322c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10400:x1875173741464448:12345-192.168.201.38@tcp:35:bash.0 Request processed in 255us (440us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788305312.956921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788305313.058687:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305313.058796:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741464704 00000100:00100000:2.0:1788305313.058806:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741464704 00000100:00100000:2.0:1788305313.058885:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:2.0:1788305313.058896:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10410:x1875173741464704:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305313.058919:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305313.058940:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae892d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4d1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305313.059108:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788305313.059245:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae892d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4d1 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.059260:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:2.0:1788305313.059264:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305313.059270:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae892d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4d1 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.059284:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c200, rc 0) 00000100:00100000:2.0:1788305313.059336:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+49:10410:x1875173741464704:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 441us (659us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1788305313.059344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00080000:3.0:1788305313.059617:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305313.062744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.062842:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741464832 00000100:00100000:3.0:1788305313.062852:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741464832 00000100:00100000:3.0:1788305313.062918:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:3.0:1788305313.062929:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+49:10410:x1875173741464832:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788305313.063161:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063177:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063186:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063210:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063217:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063223:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063324:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063332:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063351:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305313.063400:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063413:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063417:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063422:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063426:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbde00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305313.063429:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063433:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063442:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305313.063444:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305313.063447:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063452:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae893b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063460:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063468:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063472:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063475:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305313.063476:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063480:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063484:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fb87f88700) 00010000:00010000:3.0:1788305313.063485:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305313.063487:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063491:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063502:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063507:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063513:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063517:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305313.063525:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063532:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063540:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305313.063542:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305313.063545:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.063549:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8949 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305313.063695:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+49:10410:x1875173741464832:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 767us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305313.063700:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1788305313.081115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.081189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741465088 00000100:00100000:3.0:1788305313.081197:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741465088 00000100:00100000:3.0:1788305313.081254:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788305313.081265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+49:10410:x1875173741465088:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305313.081525:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+50:10410:x1875173741465088:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 263us (419us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788305313.081531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788305313.131730:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305313.131940:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741465344 00000100:00100000:2.0:1788305313.131950:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741465344 00000100:00100000:2.0:1788305313.132008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1788305313.132016:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+50:10413:x1875173741465344:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305313.132041:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305313.132090:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8950 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4d8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132162:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132175:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132194:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132210:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132216:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132223:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132366:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132375:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132383:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305313.132392:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788305313.132475:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132483:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132490:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132494:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305313.132502:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132507:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132516:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305313.132518:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305313.132521:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132526:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8957 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132534:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132537:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132541:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132544:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305313.132546:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132549:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132552:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fb88992500) 00010000:00010000:2.0:1788305313.132553:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305313.132558:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132562:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae895e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132595:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8950 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4d8 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132620:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4d8 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.132628:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305313.132631:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305313.132633:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ca00, rc 0) 00000100:00100000:2.0:1788305313.132684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+52:10413:x1875173741465344:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 669us (965us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788305313.132689:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1788305313.136912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.137047:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741465472 00000100:00100000:1.0:1788305313.137098:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741465472 00000100:00100000:1.0:1788305313.137156:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1788305313.137167:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+52:10413:x1875173741465472:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788305313.137237:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137253:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137277:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137303:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137311:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137317:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137323:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305313.137327:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137334:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.137554:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305313.137558:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305313.137562:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.138689:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305313.138855:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+52:10413:x1875173741465472:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 1686us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305313.138864:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1788305313.142320:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.142454:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741465600 00000100:00100000:3.0:1788305313.142466:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741465600 00000100:00100000:3.0:1788305313.142528:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788305313.142538:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+52:2348:x1875173741465600:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305313.142553:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305313.142603:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4d8 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.142624:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305313.142629:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305313.142688:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+51:2348:x1875173741465600:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 151us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305313.142696:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788305313.144303:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.144352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741465856 00000100:00100000:1.0:1788305313.144378:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741465856 00000100:00100000:1.0:1788305313.144426:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1788305313.144436:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+51:10413:x1875173741465856:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788305313.144677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+52:10413:x1875173741465856:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 241us (379us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788305313.144684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1788305313.286194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305313.286368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741466112 00000100:00100000:2.0:1788305313.286379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741466112 00000100:00100000:2.0:1788305313.286497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:2.0:1788305313.286510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+52:10431:x1875173741466112:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1788305313.286534:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305313.286555:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae897a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4df expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.286653:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8981 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.286684:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.286695:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305313.286708:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788305313.286832:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae897a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4df expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.286850:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4df expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.286859:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305313.286862:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788305313.286865:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c200, rc 0) 00000100:00100000:2.0:1788305313.286931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10431:x1875173741466112:12345-192.168.201.38@tcp:101:cat.0 Request processed in 425us (745us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788305313.286938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1788305313.318272:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.318392:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741466240 00000100:00100000:3.0:1788305313.318402:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741466240 00000100:00100000:3.0:1788305313.318469:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788305313.318480:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10432:x1875173741466240:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305313.318503:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305313.318525:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae898f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4e6 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.318596:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.318610:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.318623:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305313.318677:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788305313.318681:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305313.318702:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.318743:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae898f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4e6 expref: 56 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.318992:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4e6 expref: 55 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.319001:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305313.319004:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305313.319007:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc800, rc 0) 00000100:00100000:3.0:1788305313.319890:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10432:x1875173741466240:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1409us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305313.319899:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788305313.332715:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.336628:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741466624 00000100:00100000:1.0:1788305313.336643:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741466624 00000100:00100000:0.0:1788305313.342641:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1788305313.342670:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10432:x1875173741466624:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788305313.343220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10432:x1875173741466624:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 552us (10514us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788305313.343228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788305313.346244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305313.346408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741466752 00000100:00100000:2.0:1788305313.346419:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741466752 00000100:00100000:2.0:1788305313.346541:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1788305313.346553:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10432:x1875173741466752:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:2.0:1788305313.346569:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788305313.346606:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ca expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.346651:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8981 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4df expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.346664:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a48b expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.346677:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305313.346688:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305313.346748:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+53:10432:x1875173741466752:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 197us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305313.346755:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1788305313.348986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.350327:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741466880 00000100:00100000:1.0:1788305313.350339:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741466880 00000100:00100000:1.0:1788305313.350629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1788305313.350642:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+53:10432:x1875173741466880:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:1.0:1788305313.350783:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.350800:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.350812:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305313.351127:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305313.351335:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788305313.351420:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788305313.351747:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+53:10432:x1875173741466880:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 1105us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305313.351757:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1788305313.373561:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.373855:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741467008 00000100:00100000:1.0:1788305313.373864:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741467008 00000100:00100000:1.0:1788305313.374003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:1.0:1788305313.374015:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+53:10434:x1875173741467008:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305313.374034:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305313.374083:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae89a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.374157:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.374171:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.374182:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.374198:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.374206:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.374212:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374551:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374561:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374567:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305313.374669:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788305313.374673:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305313.374692:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374704:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374730:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374736:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374743:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374749:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305313.374753:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374761:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374772:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305313.374775:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305313.374780:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374787:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae89ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374801:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374806:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374812:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374823:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305313.374826:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374832:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374841:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fbb5e39600) 00010000:00010000:2.0:1788305313.374843:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305313.374845:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374850:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae89b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374883:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae89a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374897:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.374903:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:2.0:1788305313.374906:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305313.374907:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c200, rc 0) 00000100:00100000:2.0:1788305313.374980:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10434:x1875173741467008:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 967us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305313.374987:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00010000:00010000:3.0:1788305313.649439:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788305313.845291:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305313.845298:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305313.845367:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788305313.845375:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305313.845498:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fc8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761416704:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305313.845599:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305313.854368:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fc8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761416704:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305313.865790:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.867038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741467136 00000100:00100000:3.0:1788305313.867083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741467136 00000100:00100000:3.0:1788305313.867141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788305313.867152:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467136:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788305313.867241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467136:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 Request processed in 90us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305313.867258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:0.0:1788305313.870698:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.872195:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741467264 00000100:00100000:3.0:1788305313.872216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741467264 00000100:00100000:3.0:1788305313.872300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:3.0:1788305313.872317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467264:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788305313.872357:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788305313.872464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467264:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 156us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305313.872471:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1788305313.896396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305313.896428:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741467392 00000100:00100000:0.0:1788305313.896437:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741467392 00000100:00100000:0.0:1788305313.896486:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:0.0:1788305313.896496:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467392:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788305313.898307:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898333:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898365:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898387:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898394:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898401:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898428:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898445:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898452:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305313.898491:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788305313.898495:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305313.898509:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898520:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898527:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898534:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898538:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305313.898541:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898546:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898554:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:0.0:1788305313.898556:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305313.898559:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898637:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae89c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898650:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898657:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898663:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898668:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305313.898671:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898677:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898685:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff96fba21af900) 00010000:00010000:0.0:1788305313.898687:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305313.898689:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898694:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae89c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898709:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898715:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898726:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898731:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305313.898734:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898956:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898965:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:0.0:1788305313.898967:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305313.898971:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305313.898977:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae89ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305313.899300:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467392:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 2591us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305313.899312:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1788305313.910981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.911020:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741467648 00000100:00100000:3.0:1788305313.911032:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741467648 00000100:00100000:3.0:1788305313.911092:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788305313.911101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10445:x1875173741467648:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305313.911120:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305313.911137:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae89d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4f4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911228:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911244:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911255:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305313.911267:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788305313.911373:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911380:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911390:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911395:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbde00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305313.911398:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911403:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911412:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:3.0:1788305313.911415:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305313.911418:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911422:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae89dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911452:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae89d5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4f4 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911459:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305313.911460:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305313.911463:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae89d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4f4 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.911468:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc200, rc 0) 00000100:00100000:3.0:1788305313.911527:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10445:x1875173741467648:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 426us (555us total) trans 4294967352 rc 301/301 00000100:00100000:3.0:1788305313.911543:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788305313.920359:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305313.920471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741467776 00000100:00100000:2.0:1788305313.920487:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741467776 00000100:00100000:2.0:1788305313.920547:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:2.0:1788305313.920558:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10445:x1875173741467776:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305313.920592:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305313.920694:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10445:x1875173741467776:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 137us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305313.920701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1788305313.924386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.924854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741468032 00000100:00100000:3.0:1788305313.924865:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741468032 00000100:00100000:3.0:1788305313.924920:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1788305313.924931:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10445:x1875173741468032:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305313.924951:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305313.924955:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788305313.924991:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4e6 expref: 55 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.925009:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305313.925014:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305313.925027:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae89ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a4fb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305313.925484:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788305313.925691:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae89f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.925705:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae89f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.925715:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae89f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.925783:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae89ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4fb expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.925810:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae89f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4fb expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.925817:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:3.0:1788305313.925819:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305313.925821:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd000, rc 0) 00000100:00100000:3.0:1788305313.925889:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10445:x1875173741468032:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 959us (1516us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788305313.925897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1788305313.935684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.935762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741468288 00000100:00100000:1.0:1788305313.935772:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741468288 00000100:00100000:1.0:1788305313.935831:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:1.0:1788305313.935842:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10445:x1875173741468288:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305313.935902:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305313.935930:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae89f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4fb expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.935948:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:1.0:1788305313.935960:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305313.935981:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.935995:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936019:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936026:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936033:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936139:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936157:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936163:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936169:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305313.936173:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936180:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936189:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:1.0:1788305313.936192:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305313.936196:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936202:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae89ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936212:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936217:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936222:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936227:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305313.936235:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936241:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936249:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x82d8fe07 (ffff96fbb5e39600) 00010000:00010000:1.0:1788305313.936252:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305313.936255:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.936260:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x82d8fe07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305313.936360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10445:x1875173741468288:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 508us (671us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305313.936367:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:1.0:1788305313.941885:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.942807:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741468416 00000100:00100000:3.0:1788305313.942820:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741468416 00000100:00100000:3.0:1788305313.942890:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1788305313.942901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10445:x1875173741468416:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305313.942922:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305313.942945:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae8a0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a502 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.942981:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.942993:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.943005:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.943126:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae8a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.943146:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.943154:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:3.0:1788305313.943157:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305313.943161:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc800, rc 0) 00000100:00100000:2.0:1788305313.943383:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10445:x1875173741468416:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 483us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305313.943390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:1.0:1788305313.946433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.946553:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741468672 00000100:00100000:3.0:1788305313.946563:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741468672 00000100:00100000:3.0:1788305313.946621:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1788305313.946632:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10445:x1875173741468672:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305313.946712:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.946727:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305313.946892:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305313.948399:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788305313.948413:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331658359299ns, next at 332658356193ns, rc = 0 00000004:00010000:1.0:1788305313.948578:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023b6b79d reply state 00000000f06e10fd transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305313.948589:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305313.948752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+58:10445:x1875173741468672:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 2119us (2327us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788305313.948761:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00010000:00010000:2.0:1788305313.959151:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.959168:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.959175:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.959182:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305313.959186:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.959194:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.959210:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:2.0:1788305313.959214:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788305313.959218:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305313.959240:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8a1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305313.964739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305313.965092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741468800 00000100:00100000:1.0:1788305313.965103:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741468800 00000100:00100000:1.0:1788305313.965175:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:1.0:1788305313.965186:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10445:x1875173741468800:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305313.965208:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305313.965227:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a509 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.965300:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.965315:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305313.965333:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:1.0:1788305313.965336:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305313.965341:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e000, rc 0) 00000100:00100000:1.0:1788305313.965415:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+58:10445:x1875173741468800:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 230us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305313.965421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:1.0:1788305313.968384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305313.968511:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741468928 00000100:00100000:3.0:1788305313.968521:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741468928 00000100:00100000:3.0:1788305313.968569:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1788305313.968577:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875173741468928:12345-192.168.201.38@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788305313.968608:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:3.0:1788305313.968649:0:6677:0:(genops.c:1385:class_connect()) connect: client 5455d24f-893c-4899-b5f9-16679e9a93aa, cookie 0x902a3611c9ae8a29 00002000:00100000:3.0:1788305313.968661:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5455d24f-893c-4899-b5f9-16679e9a93aa/ffff96fbc1ad2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788305313.968685:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788305313.968930:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788305313.968958:0:6677:0:(import.c:65:import_set_state_nolock()) ffff96fbc1ad0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305313.969288:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2346:x1875173741468928:12345-192.168.201.38@tcp:8:lhsmtool_posix.0 Request processed in 709us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305313.969297:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1788305313.973444:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305313.975196:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741469056 00000100:00100000:2.0:1788305313.975209:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741469056 00000100:00100000:1.0:1788305313.978186:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:1.0:1788305313.978200:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:0:x1875173741469056:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788305313.981876:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788305314.113419:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:2.0:1788305314.113463:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788305314.113468:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788305314.113501:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788305314.113516:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fb889f5840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788305314.113521:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb89040300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fb889f5180 00000020:00080000:2.0:1788305314.113524:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb89040b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fa81b3ac00 00000020:00080000:2.0:1788305314.113751:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788305314.113872:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788305314.113892:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761416832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788305314.113959:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305314.114034:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761416960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788305314.114077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305314.114113:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305314.114122:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788305314.114137:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305314.114143:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761416832 00000100:00100000:2.0:1788305314.114149:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761416832 00000100:00100000:2.0:1788305314.114189:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305314.114195:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761416960 00000100:00100000:2.0:1788305314.114198:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761416960 00000100:00080000:2.0:1788305314.114304:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305314.114313:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305314.114484:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788305314.114495:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761416832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305314.114714:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761416832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (754us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788305314.114721:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788305314.114760:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fbaf58c700/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788305314.114771:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761416832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305314.114791:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305314.114797:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761416960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788305314.114811:0:11977:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788305314.114839:0:11977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a975f9f, atime: 0x6a975f9f, ctime: 0x6a975f9f, blocks: 0x1 00010000:00010000:0.0:1788305314.114847:0:11977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.114862:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788305314.114866:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305314.114872:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.114886:0:11977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.114896:0:11977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.114903:0:11977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.114919:0:11977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305314.114929:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305314.114934:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.114997:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305314.115002:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.115010:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.115025:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.115033:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f6f37d6/0x902a3611c9ae8a30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.115047:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305314.115049:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305314.115072:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305314.122787:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761416960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7983us (8703us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788305314.122799:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:3.0:1788305314.123873:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fbaf58df80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788305314.123883:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761416960:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788305314.135230:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788305314.135248:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000100:00100000:2.0:1788305314.135955:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:0:x1875173741469056:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 157751us (162515us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788305314.135967:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:3.0:1788305314.141882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305314.141918:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741469312 00000100:00100000:3.0:1788305314.141928:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741469312 00000100:00100000:3.0:1788305314.141992:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788305314.142002:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+12:10445:x1875173741469312:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788305314.143301:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10445:x1875173741469312:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1295us (1422us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788305314.143311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1788305314.145890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305314.145926:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741469568 00000100:00100000:3.0:1788305314.145936:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741469568 00000100:00100000:3.0:1788305314.147168:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:3.0:1788305314.147181:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10445:x1875173741469568:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305314.147677:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10445:x1875173741469568:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 498us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305314.147685:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:3.0:1788305314.158091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.159354:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741469696 00000100:00100000:1.0:1788305314.159367:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741469696 00000100:00100000:1.0:1788305314.159453:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:1.0:1788305314.159464:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10445:x1875173741469696:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305314.160844:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305314.160867:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae8a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a510 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.160937:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.160951:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.160962:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305314.161009:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305314.161027:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.161069:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae8a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a510 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.161084:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a510 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.161092:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:1.0:1788305314.161095:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788305314.161099:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f800, rc 0) 00000100:00100000:1.0:1788305314.161164:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741469696:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1702us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.161181:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1788305314.166182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305314.166632:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741469824 00000100:00100000:2.0:1788305314.166643:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741469824 00000100:00100000:2.0:1788305314.166703:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:2.0:1788305314.166714:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741469824:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305314.166734:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305314.166757:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a517 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305314.166785:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a975fa1, blocks: 0x1 00010000:00010000:2.0:1788305314.166804:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1788305314.166808:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305314.166818:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.166839:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.166852:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c600, rc 0) 00000100:00100000:2.0:1788305314.166913:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741469824:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 200us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305314.166920:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1788305314.173146:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305314.174090:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470080 00000100:00100000:0.0:1788305314.174100:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470080 00000100:00100000:0.0:1788305314.174159:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:0.0:1788305314.174170:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741470080:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788305314.174278:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741470080:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 110us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.174287:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1788305314.178435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305314.179432:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470208 00000100:00100000:0.0:1788305314.179442:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470208 00000100:00100000:0.0:1788305314.179651:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788305314.179662:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:10445:x1875173741470208:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305314.179682:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305314.179700:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a51e expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.179727:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.179737:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305314.179741:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305314.179747:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 7 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.179780:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.179794:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305314.179808:0:11977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761417088:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305314.179892:0:11977:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305314.183090:0:11977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761417088:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305314.183133:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 7 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.183172:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fc400, rc 0) 00000100:00100000:0.0:1788305314.183239:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:10445:x1875173741470208:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 3577us (4812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.183247:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:3.0:1788305314.185958:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305314.186162:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470336 00000100:00100000:2.0:1788305314.186182:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470336 00010000:00010000:2.0:1788305314.186222:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305314.186394:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:2.0:1788305314.186407:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83072850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2348:x1875173741470336:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305314.186422:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305314.186447:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.186462:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.186486:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae8a45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a517 expref: 7 pid: 6678 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.186501:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305314.186505:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305314.186514:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 6 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.186523:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 6 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.186571:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 6 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305314.186595:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875173761417216:192.168.201.38@tcp:105: 00000100:00100000:2.0:1788305314.186670:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e64480 going to sleep for 11 seconds 00000100:00100000:3.0:1788305314.192981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305314.193102:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470464 00000100:00100000:0.0:1788305314.193112:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470464 00002000:00100000:0.0:1788305314.193160:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff96fb985b7480 x1875173741470464/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:245/0 lens 504/0 e 0 to 0 dl 1788305325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305314.193170:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fb985b7480 with x1875173741470464 ext(0->8) 00002000:00010000:0.0:1788305314.193176:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fb985b7480 00000100:00100000:0.0:1788305314.193214:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1788305314.193223:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741470464:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788305314.193850:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741470464:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 626us (878us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788305314.193860:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00002000:00100000:0.0:1788305314.193868:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff96fb985b7480 x1875173741470464/t4294967303(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:245/0 lens 504/448 e 0 to 0 dl 1788305325 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305314.193877:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fb985b7480 with x1875173741470464 ext(0->8) 00002000:00010000:0.0:1788305314.193880:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fb985b7480 00000100:00100000:2.0:1788305314.195678:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875173761417216:192.168.201.38@tcp:105: 00010000:00010000:2.0:1788305314.195719:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305314.195768:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83072850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741470336:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 9363us (9819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305314.195778:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788305314.209572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305314.209611:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470592 00000100:00100000:3.0:1788305314.209622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470592 00000100:00100000:3.0:1788305314.209674:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:3.0:1788305314.209684:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741470592:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788305314.209802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741470592:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305314.209810:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000040:00080000:3.0:1788305314.212878:0:11991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305314.212887:0:11991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305314.212924:0:11991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788305314.212930:0:11991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305314.222322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305314.223381:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470720 00000100:00100000:2.0:1788305314.223392:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470720 00000100:00100000:2.0:1788305314.223454:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:2.0:1788305314.223465:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741470720:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788305314.302842:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788305314.302860:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788305314.303043:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741470720:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 79573us (80722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305314.303075:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:3.0:1788305314.309641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.309729:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741470976 00000100:00100000:1.0:1788305314.309739:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741470976 00000100:00100000:1.0:1788305314.309798:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:1.0:1788305314.309809:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741470976:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305314.309856:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305314.309883:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a510 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.309900:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:1.0:1788305314.309904:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305314.309932:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.309945:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.309955:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305314.310133:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fb7af49 reply state 00000000111e09c8 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305314.310143:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305314.310238:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+15:10445:x1875173741470976:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 430us (604us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788305314.310245:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1788305314.312423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305314.312496:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741471104 00000100:00100000:2.0:1788305314.312506:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741471104 00000100:00100000:2.0:1788305314.312560:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:2.0:1788305314.312570:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741471104:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788305314.312789:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788305314.312793:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788305312 00002000:00010000:2.0:1788305314.312796:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788305311 00002000:00010000:2.0:1788305314.312797:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788305313 -> 1788305312 00002000:00010000:2.0:1788305314.312799:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788305314.312864:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2348:x1875173741471104:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 295us (449us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788305314.312871:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00010000:00010000:1.0:1788305314.315489:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.315513:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.315520:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.315527:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305314.315532:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.315539:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.315556:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:1.0:1788305314.315559:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305314.315564:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.315570:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305314.319416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305314.319500:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741471360 00000100:00100000:3.0:1788305314.319511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741471360 00000100:00100000:3.0:1788305314.319575:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:3.0:1788305314.319585:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10445:x1875173741471360:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788305314.319653:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.319671:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.319680:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.319714:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.319728:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 14 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305314.319741:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761417344:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305314.319834:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82f11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305314.327355:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.327436:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741471488 00000100:00100000:1.0:1788305314.327444:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741471488 00010000:00010000:1.0:1788305314.327484:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 15 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305314.327527:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:1.0:1788305314.327538:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:2348:x1875173741471488:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305314.327551:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305314.327566:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 15 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.327579:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 15 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.327601:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:1.0:1788305314.327606:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.327615:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.327622:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.327640:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305314.327690:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:2348:x1875173741471488:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.327697:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00010000:00010000:3.0:1788305314.332523:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a502 expref: 14 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305314.332547:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761417344:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305314.332571:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332736:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332745:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332773:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332780:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332788:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332794:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbde00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305314.332799:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332806:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332822:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:2.0:1788305314.332825:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788305314.332830:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.332846:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8a5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305314.332930:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10445:x1875173741471360:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 13345us (13522us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788305314.332941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:2.0:1788305314.335855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305314.335920:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741471616 00000100:00100000:3.0:1788305314.335931:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741471616 00000100:00100000:3.0:1788305314.335993:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:3.0:1788305314.336004:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741471616:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788305314.336048:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.336096:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 7 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.336104:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788305314.336109:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305314.336113:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.336147:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 7 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.336160:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 7 pid: 11977 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305314.336175:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875173761417472:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305314.336258:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82f11f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305314.343944:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305314.344048:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741471744 00000100:00100000:0.0:1788305314.344081:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741471744 00010000:00010000:0.0:1788305314.344141:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 8 pid: 11977 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305314.344184:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:0.0:1788305314.344195:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741471744:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305314.344209:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305314.344229:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 8 pid: 11977 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344244:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 8 pid: 11977 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344271:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305314.344276:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305314.344283:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344291:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344311:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305314.344382:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741471744:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 189us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.344389:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00010000:00010000:0.0:1788305314.344437:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd2c19e0/0x902a3611c9ae8a4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a51e expref: 7 pid: 11977 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305314.344464:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875173761417472:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305314.344488:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344498:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344504:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344528:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344536:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344543:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344550:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbca00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305314.344757:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344770:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344789:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.344797:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ac5bef4/0x902a3611c9ae8a61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305314.344842:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741471616:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 8840us (8995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.344851:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1788305314.349305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.349380:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472000 00000100:00100000:1.0:1788305314.349391:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472000 00000100:00100000:1.0:1788305314.349449:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:1.0:1788305314.349461:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10445:x1875173741472000:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788305314.349537:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349564:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349592:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349826:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349837:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349846:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349877:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.349891:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 14 pid: 5832 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305314.349906:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761417600:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305314.349979:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305314.358834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305314.358967:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761417600:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305314.358992:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305314.363567:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472128 00000100:00100000:3.0:1788305314.363579:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472128 00010000:00010000:3.0:1788305314.363625:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 15 pid: 5832 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305314.367426:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1788305314.367447:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:2348:x1875173741472128:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305314.367467:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305314.367479:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 15 pid: 5832 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.367495:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 15 pid: 5832 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.367518:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a509 expref: 15 pid: 5832 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.367532:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:3.0:1788305314.367537:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.367548:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.367555:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305314.367589:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305314.367652:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+14:2348:x1875173741472128:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 212us (8827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305314.367659:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00010000:00010000:0.0:1788305314.367754:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.367762:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305314.367938:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788305314.368160:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788305314.368206:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788305314.368282:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761417728:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788305314.368350:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305314.368383:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305314.368403:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761417728 00000100:00100000:0.0:1788305314.368408:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761417728 00000100:00100000:0.0:1788305314.368455:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305314.368464:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8201:x1875173761417728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788305314.368527:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8201:x1875173761417728:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.368534:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305314.368576:0:8201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788305314.368581:0:8201:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fbaf58c700, transno 4294967302 00000100:00100000:0.0:1788305314.368593:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761417728:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788305314.369095:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788305314.369145:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761417856:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788305314.369182:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305314.369197:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305314.369361:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761417856 00000100:00100000:0.0:1788305314.369366:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761417856 00000100:00100000:0.0:1788305314.369388:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305314.369394:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8201:x1875173761417856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788305314.369523:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8201:x1875173761417856:12345-0@lo:1000:mdt00_003.0 Request processed in 128us (339us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788305314.369530:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305314.369562:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761417856:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788305314.369587:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369596:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369604:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369615:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305314.369620:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369627:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369642:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:0.0:1788305314.369645:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305314.369648:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369654:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369684:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369690:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369696:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369701:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305314.369703:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369709:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369724:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:0.0:1788305314.369726:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305314.369729:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369735:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae899d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369754:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369765:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369773:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369793:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305314.369805:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 17 pid: 5834 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305314.369815:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761417984:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305314.369858:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb98580cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305314.382584:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.387354:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472256 00000100:00100000:1.0:1788305314.387367:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472256 00010000:00010000:1.0:1788305314.387408:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 18 pid: 5834 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305314.387450:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:1.0:1788305314.387467:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+18:2347:x1875173741472256:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305314.387482:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305314.387490:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 18 pid: 5834 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387503:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 18 pid: 5834 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387525:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:1.0:1788305314.387530:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387540:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387548:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387577:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305314.387636:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+18:2347:x1875173741472256:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 170us (5059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.387643:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00010000:00010000:1.0:1788305314.387695:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae89b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a4ed expref: 17 pid: 5834 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305314.387707:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761417984:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305314.387731:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387749:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387755:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387767:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387773:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387779:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387786:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305314.387789:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387797:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387806:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:1.0:1788305314.387808:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305314.387812:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387817:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8a76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387828:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387842:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387847:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387852:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305314.387855:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387861:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387870:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fbb5e39100) 00010000:00010000:1.0:1788305314.387872:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305314.387875:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.387881:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8a68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305314.388105:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+16:10445:x1875173741472000:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 38645us (38809us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1788305314.388114:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000020:00080000:1.0:1788305314.388118:0:8201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788305314.388362:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305314.388367:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305314.388393:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788305314.388400:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788305314.391722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305314.391761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472512 00000100:00100000:2.0:1788305314.391771:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472512 00000100:00100000:2.0:1788305314.391822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1788305314.391832:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+16:10445:x1875173741472512:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788305314.392955:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788305314.393294:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:2.0:1788305314.393359:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.393376:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.393387:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.393459:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.393468:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.393482:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305314.393507:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788305314.393727:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10445:x1875173741472512:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1894us (2013us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788305314.393736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000020:00080000:2.0:1788305314.393743:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788305314.395034:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305314.395074:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.395085:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305314.395089:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.395098:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.395114:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96fb88992a00) 00010000:00010000:1.0:1788305314.395117:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788305314.395122:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.395132:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8a7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305314.395152:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305314.395153:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305314.395155:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305314.445228:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.445352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305314.445394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305314.445479:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472640 00000100:00100000:3.0:1788305314.445502:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472640 00000100:00100000:3.0:1788305314.445572:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 287 00000100:00100000:3.0:1788305314.445583:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741472640:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305314.445655:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741472640:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305314.445663:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 287 00000100:00100000:0.0:1788305314.445949:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472896 00000100:00100000:0.0:1788305314.445954:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472896 00000100:00100000:0.0:1788305314.446008:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:0.0:1788305314.446018:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741472896:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305314.446082:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741472896:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 66us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.446090:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00080000:3.0:1788305314.446258:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305314.447764:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741472768 00000100:00100000:2.0:1788305314.447776:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741472768 00000100:00100000:2.0:1788305314.447838:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1788305314.447847:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741472768:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305314.447916:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741472768:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305314.447924:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00080000:3.0:1788305314.447952:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305314.546829:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761418240:0@lo:400:kworker.0 00000100:00100000:0.0:1788305314.546904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305314.546985:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305314.546993:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761418368:0@lo:400:kworker.0 00000100:00100000:0.0:1788305314.547019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305314.547149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418240 00000100:00100000:1.0:1788305314.547157:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418240 00000100:00100000:1.0:1788305314.547205:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418368 00000100:00100000:1.0:1788305314.547209:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418368 00000100:00100000:1.0:1788305314.547245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788305314.547255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761418240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305314.547312:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761418240:12345-0@lo:400:kworker.0 Request processed in 59us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.547330:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788305314.547359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788305314.547365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761418368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305314.547395:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761418368:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.547401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788305314.547417:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761418496:0@lo:400:kworker.0 00000100:00080000:1.0:1788305314.547431:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305314.547447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305314.547469:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788305314.547476:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761418112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305314.547480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418496 00000100:00100000:1.0:1788305314.547482:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418496 00000100:00100000:3.0:1788305314.547503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305314.547510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788305314.547516:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761418496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305314.547522:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761418624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305314.547542:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305314.547545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761418496:12345-0@lo:400:kworker.0 Request processed in 30us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.547550:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788305314.547564:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305314.547573:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761418496:0@lo:400:kworker.0 00000100:00100000:1.0:1788305314.547582:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418624 00000100:00100000:1.0:1788305314.547585:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418624 00000100:00100000:1.0:1788305314.547605:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305314.547611:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761418624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305314.547645:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761418624:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305314.547650:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305314.547674:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761418624:0@lo:400:kworker.0 00000100:00100000:0.0:1788305314.548133:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418112 00000100:00100000:0.0:1788305314.548139:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418112 00000100:00100000:0.0:1788305314.548174:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788305314.548182:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761418112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305314.548227:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761418112:12345-0@lo:400:kworker.0 Request processed in 46us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305314.548234:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788305314.548276:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761418368:0@lo:400:kworker.0 00000100:00100000:0.0:1788305314.548286:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761418240:0@lo:400:kworker.0 00000100:00100000:1.0:1788305314.548718:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761418112:0@lo:400:kworker.0 00010000:00010000:0.0:1788305314.673646:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305315.057575:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761418752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305315.057648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305315.058032:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418752 00000100:00100000:1.0:1788305315.058067:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418752 00000100:00100000:1.0:1788305315.058113:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305315.058123:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761418752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305315.058145:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788305315.058194:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761418752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305315.058200:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305315.058354:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761418752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305315.058593:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761418880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305315.058625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305315.058659:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761418880 00000100:00100000:3.0:1788305315.058663:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761418880 00000100:00100000:3.0:1788305315.058692:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788305315.058699:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875173761418880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305315.058721:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305315.058758:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875173761418880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305315.058765:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305315.058782:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761418880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788305315.698691:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305315.905039:0:12043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305315.905379:0:12043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305315.905435:0:12043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788305315.905442:0:12043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305315.998887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305315.998980:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741473152 00000100:00100000:1.0:1788305315.998994:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741473152 00000100:00080000:3.0:1788305315.999196:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305315.999498:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:1.0:1788305315.999513:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10464:x1875173741473152:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305315.999721:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305315.999749:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a525 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.000521:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.000795:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.000809:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305316.000832:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788305316.001129:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a525 expref: 21 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.001148:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a525 expref: 20 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.001158:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:1.0:1788305316.001173:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305316.001177:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f800, rc 0) 00000100:00100000:1.0:1788305316.001269:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10464:x1875173741473152:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1759us (2397us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788305316.001278:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:1.0:1788305316.003570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.003705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741473280 00000100:00100000:3.0:1788305316.003724:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741473280 00000100:00100000:3.0:1788305316.003796:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:3.0:1788305316.003809:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10464:x1875173741473280:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788305316.003909:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.003929:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.003942:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.003960:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.003968:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.003975:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.004963:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.004980:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.004991:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305316.005088:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005116:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005123:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005131:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005138:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.005142:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005151:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005165:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305316.005169:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.005174:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005181:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005196:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005203:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005209:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005220:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.005223:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005229:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005237:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fb87f88500) 00010000:00010000:3.0:1788305316.005240:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.005327:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005334:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae8aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005349:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005355:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005361:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005366:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.005369:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005376:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005394:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305316.005396:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.005399:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.005405:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.005511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10464:x1875173741473280:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1699us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.005522:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:1.0:1788305316.068755:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.068857:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741473536 00000100:00100000:0.0:1788305316.068869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741473536 00000100:00100000:0.0:1788305316.068951:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:0.0:1788305316.068961:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10467:x1875173741473536:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305316.068984:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.069007:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae8aae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a52c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.069413:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.069433:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.069446:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.069462:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.069469:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.069476:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070006:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070014:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070019:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.070028:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788305316.070444:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070451:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070462:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070467:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.070471:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070477:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070489:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.070492:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.070495:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070500:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8ab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070511:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070514:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070518:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070521:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.070523:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070535:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070544:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21aff00) 00010000:00010000:0.0:1788305316.070546:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.070548:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070554:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8abc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070605:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd800/0x902a3611c9ae8aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070617:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.070623:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:0.0:1788305316.070624:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305316.070625:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd400, rc 0) 00000100:00100000:0.0:1788305316.070705:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+22:10467:x1875173741473536:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1745us (1964us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788305316.070713:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:0.0:1788305316.073802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.073851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741473664 00000100:00100000:1.0:1788305316.073864:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741473664 00000100:00100000:1.0:1788305316.073930:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:1.0:1788305316.073944:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:10467:x1875173741473664:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788305316.074027:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074044:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074156:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074222:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074230:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074238:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074245:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.074250:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074259:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074273:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:1.0:1788305316.074277:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305316.074282:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.074289:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.074390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:10467:x1875173741473664:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 449us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.074399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:1.0:1788305316.076939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305316.077011:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741473920 00000100:00100000:2.0:1788305316.077022:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741473920 00000100:00100000:3.0:1788305316.077239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788305316.077265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:10467:x1875173741473920:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305316.077614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:10467:x1875173741473920:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 354us (686us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788305316.077620:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1788305316.095412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.095596:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741474176 00000100:00100000:1.0:1788305316.095611:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741474176 00000100:00100000:1.0:1788305316.095793:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:1.0:1788305316.095804:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+23:9987:x1875173741474176:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305316.095833:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305316.095856:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a533 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.095971:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.095984:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.095992:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.096027:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.096038:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 24 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.096050:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb439880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761419008:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305316.096386:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305316.099398:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb439880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761419008:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305316.099443:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.099734:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.099878:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741474304 00000100:00100000:1.0:1788305316.099904:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741474304 00010000:00010000:1.0:1788305316.099952:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 25 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.099986:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1788305316.099995:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+25:2348:x1875173741474304:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305316.100012:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305316.100018:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 25 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.100029:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 25 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.100357:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a52c expref: 25 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.100378:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:1.0:1788305316.100383:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.100391:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.100398:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.100466:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305316.100493:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.100512:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.100536:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:2.0:1788305316.100542:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+24:2348:x1875173741474304:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 547us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305316.100550:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00010000:00010000:0.0:1788305316.100907:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8ad8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 25 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.100920:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 24 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.100926:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:0.0:1788305316.100929:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788305316.100930:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fc00, rc 0) 00000100:00100000:0.0:1788305316.100965:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+24:9987:x1875173741474176:12345-192.168.201.38@tcp:101:bash.0 Request processed in 5164us (5570us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788305316.100970:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:0.0:1788305316.103896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.103943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741474560 00000100:00100000:3.0:1788305316.103954:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741474560 00000100:00100000:3.0:1788305316.104134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:3.0:1788305316.104184:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+24:9987:x1875173741474560:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:3.0:1788305316.104568:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.104586:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.104597:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305316.104876:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:3.0:1788305316.104907:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002da08f2d reply state 00000000d6c1bf67 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.104917:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788305316.104966:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:3.0:1788305316.105147:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+28:9987:x1875173741474560:12345-192.168.201.38@tcp:36:bash.0 Request processed in 985us (1259us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788305316.105156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000020:00080000:3.0:1788305316.105161:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788305316.107750:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.107768:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.107776:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.107783:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305316.107787:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.107794:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.107811:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:2.0:1788305316.107814:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305316.107819:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.107825:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8aed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.107934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.108036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741474688 00000100:00100000:1.0:1788305316.108048:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741474688 00000100:00100000:1.0:1788305316.108352:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:1.0:1788305316.108366:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+27:9987:x1875173741474688:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305316.108411:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305316.108432:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae8af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a53a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.108496:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae8af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a53a expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.108507:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae8af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a53a expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.108534:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:1.0:1788305316.108537:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305316.108540:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e800, rc 0) 00000100:00100000:1.0:1788305316.108609:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+28:9987:x1875173741474688:12345-192.168.201.38@tcp:101:bash.0 Request processed in 247us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.108614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:2.0:1788305316.110789:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.110881:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741474816 00000100:00100000:3.0:1788305316.110897:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741474816 00000100:00080000:1.0:1788305316.110956:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305316.110995:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1788305316.111009:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:9987:x1875173741474816:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305316.111028:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305316.111049:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a541 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305316.111130:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a975fa0, atime: 0x6a975f9f, ctime: 0x6a975fa0, blocks: 0xb 00010000:00010000:3.0:1788305316.111153:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1788305316.111158:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305316.111167:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.111188:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.111223:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd600, rc 0) 00000100:00100000:3.0:1788305316.111323:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:9987:x1875173741474816:12345-192.168.201.38@tcp:101:bash.0 Request processed in 318us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.111331:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788305316.113033:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.117488:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741474944 00000100:00100000:3.0:1788305316.117503:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741474944 00002000:00010000:2.0:1788305316.117610:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788305316.117618:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbaf58f800 with x1875173741474944 ext(0->18446744073709551615) 00002000:00010000:2.0:1788305316.117639:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbaf58f800. 00000100:00100000:2.0:1788305316.117682:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1788305316.117692:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741474944:12345-192.168.201.38@tcp:10:bash.0 00002000:00010000:2.0:1788305316.118023:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788305316.118026:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788305312 -> 1788305315 00002000:00010000:2.0:1788305316.118028:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788305311 -> 1788305311 00002000:00010000:2.0:1788305316.118030:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788305312 -> 1788305315 00002000:00010000:2.0:1788305316.118032:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788305316.118406:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741474944:12345-192.168.201.38@tcp:10:bash.0 Request processed in 715us (5384us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788305316.118414:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00010000:2.0:1788305316.118419:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788305316.118421:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbaf58f800 with x1875173741474944 ext(0->18446744073709551615) 00002000:00010000:2.0:1788305316.118424:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbaf58f800. 00000100:00100000:1.0:1788305316.165153:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.165340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741475072 00000100:00100000:0.0:1788305316.165352:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741475072 00000100:00100000:0.0:1788305316.165415:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:0.0:1788305316.165424:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+28:10481:x1875173741475072:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788305316.165510:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.165664:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.165697:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.165713:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.165718:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.165722:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166007:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166014:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166018:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305316.166490:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166503:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166508:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166513:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166579:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.166583:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166589:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166602:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.166604:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.166607:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166612:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166672:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166677:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166681:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166684:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.166685:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166688:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166702:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21aff00) 00010000:00010000:0.0:1788305316.166704:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.166706:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166710:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166722:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166726:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166729:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166732:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.166734:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166737:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166741:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:0.0:1788305316.166742:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.166743:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.166746:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.166847:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+28:10481:x1875173741475072:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1419us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.166856:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:1.0:1788305316.186565:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.186690:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741475328 00000100:00100000:0.0:1788305316.186702:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741475328 00000100:00100000:0.0:1788305316.186793:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:0.0:1788305316.186803:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+28:10484:x1875173741475328:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305316.186827:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.186850:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a548 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.186928:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.186942:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.186952:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.186965:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.186970:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.186974:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187446:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8b2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187454:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187459:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.187468:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788305316.187575:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187581:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187586:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187590:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.187594:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187599:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187610:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.187612:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.187615:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187626:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc400/0x902a3611c9ae8b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187641:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187644:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187648:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187651:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.187653:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187656:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187660:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21aff00) 00010000:00010000:0.0:1788305316.187661:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.187663:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187666:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fc000/0x902a3611c9ae8b25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187701:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd400/0x902a3611c9ae8b17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a548 expref: 31 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187711:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a548 expref: 30 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.187721:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:0.0:1788305316.187722:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788305316.187724:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc21fd200, rc 0) 00000100:00100000:0.0:1788305316.187798:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+30:10484:x1875173741475328:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 996us (1245us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788305316.187806:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:2.0:1788305316.190217:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.190284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741475456 00000100:00100000:3.0:1788305316.190297:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741475456 00000100:00100000:3.0:1788305316.190375:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:3.0:1788305316.190388:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:10484:x1875173741475456:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1788305316.190472:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.190491:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 30 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.190502:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.190551:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 30 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.190562:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 30 pid: 8201 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.190576:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761419136:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305316.190687:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e64900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305316.192705:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761419136:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305316.192742:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.192991:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.193047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741475712 00000100:00100000:3.0:1788305316.193080:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741475712 00000100:00100000:3.0:1788305316.193141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1788305316.193149:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+31:5587:x1875173741475712:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788305316.193707:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+32:5587:x1875173741475712:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 556us (716us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788305316.193714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788305316.195268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.195354:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741475840 00000100:00100000:1.0:1788305316.195364:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741475840 00010000:00010000:1.0:1788305316.195399:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 32 pid: 8201 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.195465:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:1.0:1788305316.195473:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+32:2348:x1875173741475840:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305316.195485:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305316.195507:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 32 pid: 8201 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.195518:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 32 pid: 8201 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.195550:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8adf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a533 expref: 32 pid: 8201 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.195564:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:1.0:1788305316.195569:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.195577:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.195583:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.195612:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305316.195642:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.195650:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.195679:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+31:2348:x1875173741475840:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 206us (419us total) trans 0 rc 0/0 00010000:00010000:2.0:1788305316.195682:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.195689:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.195689:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00010000:00010000:2.0:1788305316.195696:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.195713:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305316.195719:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.195727:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.195738:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:2.0:1788305316.195741:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305316.195745:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.195751:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.195792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:10484:x1875173741475456:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 5407us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305316.195801:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:2.0:1788305316.197443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.197482:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741476096 00000100:00100000:0.0:1788305316.197492:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741476096 00000100:00100000:0.0:1788305316.197604:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1788305316.197613:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:10484:x1875173741476096:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788305316.197920:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+31:10484:x1875173741476096:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 305us (486us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788305316.197927:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1788305316.237122:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.237384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741476352 00000100:00100000:1.0:1788305316.237398:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741476352 00000100:00100000:1.0:1788305316.237473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:1.0:1788305316.237485:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+31:10495:x1875173741476352:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:1.0:1788305316.237518:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305316.237545:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a54f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.237652:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.237666:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.237676:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.237687:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.237692:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.237696:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238008:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238015:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238019:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305316.238027:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788305316.238381:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238389:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238403:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238409:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.238415:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238422:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238438:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:1.0:1788305316.238442:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305316.238446:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238453:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8b48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238469:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238475:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238481:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238486:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.238489:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238505:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238513:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fbb5e39100) 00010000:00010000:1.0:1788305316.238516:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305316.238518:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238524:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238580:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a54f expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238597:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a54f expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.238605:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:1.0:1788305316.238607:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305316.238610:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e000, rc 0) 00000100:00100000:1.0:1788305316.238743:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+33:10495:x1875173741476352:12345-192.168.201.38@tcp:101:cat.0 Request processed in 1258us (1635us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788305316.238752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1788305316.243574:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.244669:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741476608 00000100:00100000:0.0:1788305316.244683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741476608 00000100:00100000:0.0:1788305316.244771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:0.0:1788305316.244784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+33:10495:x1875173741476608:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:0.0:1788305316.245336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10495:x1875173741476608:12345-192.168.201.38@tcp:35:cat.0 Request processed in 553us (1776us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788305316.245346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:2.0:1788305316.262455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.262593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741476864 00000100:00100000:0.0:1788305316.262604:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741476864 00000100:00100000:0.0:1788305316.262670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:0.0:1788305316.262684:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10496:x1875173741476864:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:0.0:1788305316.262776:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788305316.262807:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae8b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a54f expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262828:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fd200/0x902a3611c9ae8b2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a548 expref: 33 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262841:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae8af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a53a expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262849:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af500) 00010000:00010000:0.0:1788305316.262860:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305316.262883:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262896:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262905:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262916:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.262925:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.263376:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.263386:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.263394:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305316.264616:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788305316.264628:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333974573573ns, next at 334974570948ns, rc = 0 00010000:00010000:0.0:1788305316.264699:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264709:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264715:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264721:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264726:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264730:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264754:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305316.264780:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264793:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264799:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264800:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305316.264806:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490e00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.264808:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264812:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264814:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81491a00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305316.264820:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264823:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264836:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264839:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305316.264843:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788305316.264846:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264848:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305316.264851:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305316.264853:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264854:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264860:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264877:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305316.264879:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305316.264879:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.264881:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305316.264884:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264891:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264896:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.264905:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264909:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264916:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.264917:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.264919:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.264924:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305316.264931:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b3331f4 reply state 00000000eed5b6b3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.264939:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305316.265038:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+33:10496:x1875173741476864:12345-192.168.201.38@tcp:36:rm.0 Request processed in 2353us (2594us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788305316.265048:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00010000:00010000:1.0:1788305316.270882:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.270906:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.270915:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.270922:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.270928:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.270937:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.270983:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21aff00) 00010000:00010000:1.0:1788305316.270986:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305316.270992:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.270999:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.302241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.302331:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741477120 00000100:00100000:0.0:1788305316.302345:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741477120 00000100:00100000:0.0:1788305316.302427:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1788305316.302441:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+32:10502:x1875173741477120:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305316.302477:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.302505:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a556 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.302683:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.302720:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.302737:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.302755:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.302762:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.302768:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305316.303798:0:8201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788305316.303960:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.303974:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.303983:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304028:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304033:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304039:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304049:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490e00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.304340:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304352:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304369:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.304372:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305316.304377:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304384:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8b87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305316.304401:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ba16fdc reply state 000000008e9a74ea transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.304412:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788305316.304446:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8b80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 35 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304461:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 34 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.304469:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:0.0:1788305316.304471:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305316.304474:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81491a00, rc 0) 00000100:00100000:0.0:1788305316.304667:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+35:10502:x1875173741477120:12345-192.168.201.38@tcp:101:bash.0 Request processed in 2228us (2443us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788305316.304682:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00010000:00010000:3.0:1788305316.308716:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.308738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:3.0:1788305316.308747:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.308759:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.308768:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.308774:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.308784:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.308808:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21af500) 00010000:00010000:3.0:1788305316.308830:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.308836:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.308843:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.309140:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741477248 00000100:00100000:1.0:1788305316.309152:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741477248 00000100:00080000:3.0:1788305316.309213:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305316.309430:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:1.0:1788305316.309445:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741477248:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305316.309468:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305316.309494:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a55d expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305316.309527:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305316.309553:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1788305316.309558:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305316.309570:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.309593:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.309609:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fc00, rc 0) 00000100:00100000:1.0:1788305316.309691:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741477248:12345-192.168.201.38@tcp:101:bash.0 Request processed in 250us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.309707:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:2.0:1788305316.312896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.312947:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741477376 00000100:00100000:3.0:1788305316.312960:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741477376 00000100:00100000:3.0:1788305316.313109:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1788305316.313122:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc105a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+8:10502:x1875173741477376:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305316.313145:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305316.313178:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a564 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.313216:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.313224:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305316.313228:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305316.313232:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 9 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.313267:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.313278:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 9 pid: 6678 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.313321:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875173761419264:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305316.313445:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e64900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305316.317399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.317470:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741477504 00000100:00100000:1.0:1788305316.317483:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741477504 00010000:00010000:1.0:1788305316.317542:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 10 pid: 6678 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.317596:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:1.0:1788305316.317608:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83070850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2348:x1875173741477504:12345-192.168.201.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788305316.317613:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875173761419264:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305316.317627:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305316.317650:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.317670:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd800, rc 0) 00000100:00100000:3.0:1788305316.317752:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc105a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+10:10502:x1875173741477376:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4633us (4868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.317761:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00010000:00010000:1.0:1788305316.317806:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 9 pid: 6678 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.317820:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 9 pid: 6678 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.317848:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8ba3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a55d expref: 9 pid: 6678 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.317863:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305316.317868:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305316.317877:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.317886:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.317952:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.317967:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb438380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875173761419392:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788305316.318028:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb98580cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305316.321542:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb438380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875173761419392:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788305316.321571:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305316.321631:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83070850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741477504:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4026us (4244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.321644:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:2.0:1788305316.322467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.322589:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741477760 00000100:00100000:3.0:1788305316.322600:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741477760 00000100:00100000:3.0:1788305316.322665:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:3.0:1788305316.322676:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10502:x1875173741477760:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1788305316.323291:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+35:10502:x1875173741477760:12345-192.168.201.38@tcp:35:bash.0 Request processed in 614us (825us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788305316.323301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788305316.427836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.427962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741477888 00000100:00100000:0.0:1788305316.427976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741477888 00000100:00100000:0.0:1788305316.428091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:0.0:1788305316.428106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+35:10518:x1875173741477888:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305316.428140:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.428177:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a56b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.428404:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.428420:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.428500:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.428636:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788305316.428641:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305316.428935:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.428968:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a56b expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.428993:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a56b expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.429026:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.429029:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305316.429034:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81490000, rc 0) 00000100:00100000:0.0:1788305316.429240:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+36:10518:x1875173741477888:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1136us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.429248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:2.0:1788305316.433735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.433894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741478144 00000100:00100000:1.0:1788305316.433906:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741478144 00000100:00100000:1.0:1788305316.433970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:1.0:1788305316.433983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+36:10518:x1875173741478144:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305316.434013:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305316.434038:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a572 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.434218:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.434236:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.434251:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305316.434279:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788305316.434449:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a572 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.434471:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a572 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.434481:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:1.0:1788305316.434484:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305316.434489:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f000, rc 0) 00000100:00100000:1.0:1788305316.434601:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+38:10518:x1875173741478144:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 621us (883us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788305316.434608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:2.0:1788305316.436597:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.437113:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741478272 00000100:00100000:3.0:1788305316.437125:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741478272 00000100:00100000:3.0:1788305316.437205:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:3.0:1788305316.437218:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+38:2347:x1875173741478272:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305316.437237:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305316.437268:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a572 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.437320:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:3.0:1788305316.437328:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305316.437398:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:2347:x1875173741478272:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 182us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.437406:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305316.437508:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.437750:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741478528 00000100:00100000:0.0:1788305316.437756:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741478528 00000100:00100000:0.0:1788305316.437810:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:0.0:1788305316.437819:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:10518:x1875173741478528:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305316.437844:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.437861:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a579 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.437958:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8bdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.437970:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8bdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.437978:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8bdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.437987:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788305316.438759:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a579 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.438807:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8bdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a579 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.438817:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:0.0:1788305316.438820:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788305316.438823:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81490c00, rc 0) 00000100:00100000:0.0:1788305316.438886:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+39:10518:x1875173741478528:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1068us (1378us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788305316.438894:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:2.0:1788305316.442895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.442993:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741478656 00000100:00100000:1.0:1788305316.443005:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741478656 00000100:00100000:1.0:1788305316.443106:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:1.0:1788305316.443119:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741478656:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:1.0:1788305316.443180:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.443207:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.443216:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305316.443221:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305316.443247:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.443294:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.443317:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 8 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.443331:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb438a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875173761419520:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305316.443424:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305316.445662:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb438a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875173761419520:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305316.445705:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.447388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.447964:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741478784 00000100:00100000:3.0:1788305316.447978:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741478784 00002000:00100000:3.0:1788305316.448075:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96fbc1a95180 x1875173741478784/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:247/0 lens 504/0 e 0 to 0 dl 1788305327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305316.448090:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc1a95180 with x1875173741478784 ext(0->8) 00010000:00010000:3.0:1788305316.448103:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 9 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.448118:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 9 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305316.448124:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96fbc1a95180 00000100:00100000:3.0:1788305316.448870:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788305316.448888:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741478784:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:3.0:1788305316.449608:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+11:2347:x1875173741478784:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 724us (2344us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788305316.449617:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00100000:3.0:1788305316.449627:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96fbc1a95180 x1875173741478784/t4294967302(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:247/0 lens 504/448 e 0 to 0 dl 1788305327 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305316.449659:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc1a95180 with x1875173741478784 ext(0->8) 00010000:00010000:3.0:1788305316.449670:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 11 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.449686:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 11 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305316.449701:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96fbc1a95180 00000100:00100000:2.0:1788305316.454679:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.454852:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741478912 00000100:00100000:0.0:1788305316.454866:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741478912 00010000:00010000:0.0:1788305316.454952:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 11 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.455022:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1788305316.455035:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+11:2347:x1875173741478912:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305316.455076:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788305316.455113:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788305316.455117:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788305316 00002000:00010000:0.0:1788305316.455120:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788305316 00002000:00010000:0.0:1788305316.455122:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788305316 00010000:00010000:0.0:1788305316.455129:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 11 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.455145:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 11 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.455892:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d420cd8/0x902a3611c9ae8baa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a564 expref: 11 pid: 6675 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.455921:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305316.455926:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305316.455934:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.455946:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.455991:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305316.456253:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456265:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456301:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456328:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456352:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456359:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fc00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305316.456364:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456373:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456386:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.456393:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae8be9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.456452:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2348:x1875173741478656:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 13337us (13571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.456462:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:0.0:1788305316.456735:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2347:x1875173741478912:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1148us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.456747:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000040:00080000:1.0:1788305316.470198:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305316.470213:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305316.470262:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788305316.470275:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305316.473790:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.474427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741479168 00000100:00100000:0.0:1788305316.474442:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741479168 00000100:00100000:0.0:1788305316.474517:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:0.0:1788305316.474647:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+39:10518:x1875173741479168:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:0.0:1788305316.474756:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8bdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a579 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305316.475182:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788305316.475234:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788305316.476029:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1788305316.476616:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.476653:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 43 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.476664:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.476726:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 43 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.476746:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 43 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.476764:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875173761419648:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305316.476944:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305316.479815:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875173761419648:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305316.479855:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.480761:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.481112:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741479296 00000100:00100000:0.0:1788305316.481123:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741479296 00010000:00010000:0.0:1788305316.481191:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 44 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.481236:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:0.0:1788305316.481248:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+44:2347:x1875173741479296:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305316.481273:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305316.481289:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 44 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.481315:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 44 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.481343:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8b95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a556 expref: 44 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.481367:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:0.0:1788305316.481372:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.481383:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.481392:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.481667:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305316.481745:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+43:2347:x1875173741479296:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 497us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.481754:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00010000:00010000:1.0:1788305316.481798:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.481807:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305316.481974:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1788305316.482249:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788305316.482432:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb438700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761419776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788305316.482501:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305316.482541:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb6149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305316.482640:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761419776 00000100:00100000:0.0:1788305316.482657:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761419776 00000100:00100000:0.0:1788305316.482716:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305316.482725:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1875173761419776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788305316.482833:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1875173761419776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.482852:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788305316.482877:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305316.483026:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb438700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761419776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788305316.483677:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788305316.483829:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761419904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788305316.483891:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305316.483920:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb83069180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305316.483945:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761419904 00000100:00100000:0.0:1788305316.483952:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761419904 00000100:00100000:0.0:1788305316.483992:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305316.484002:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1875173761419904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788305316.484240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5835:x1875173761419904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 240us (349us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788305316.484248:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305316.484494:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761419904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788305316.484548:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788305316.484589:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.484601:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.484609:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.484627:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490e00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305316.484633:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.484641:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.484669:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:2.0:1788305316.484673:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788305316.484685:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.484691:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8bf0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305316.485359:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788305316.485596:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788305316.485612:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334195557790ns, next at 335195554942ns, rc = 0 00000001:00080000:2.0:1788305316.485857:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788305316.485907:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21aff00) 00010000:00010000:2.0:1788305316.485911:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788305316.485920:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8bdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a579 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.486087:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+46:10518:x1875173741479168:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 11444us (12312us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788305316.486833:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000020:00080000:2.0:1788305316.486840:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788305316.492349:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.492416:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741479424 00000100:00100000:0.0:1788305316.492439:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741479424 00000100:00100000:0.0:1788305316.492526:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:0.0:1788305316.492540:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+46:10518:x1875173741479424:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305316.492573:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.492604:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a580 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.492951:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a580 expref: 47 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.492970:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a580 expref: 47 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.492994:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305316.492998:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305316.493003:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb81491a00, rc 0) 00000100:00100000:0.0:1788305316.493106:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+47:10518:x1875173741479424:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 570us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.493135:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:1.0:1788305316.497949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.498106:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741479680 00000100:00100000:3.0:1788305316.498121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741479680 00000100:00100000:3.0:1788305316.498194:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1788305316.498208:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+47:10518:x1875173741479680:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305316.498518:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10518:x1875173741479680:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 313us (585us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788305316.498527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788305316.601736:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.601833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741479808 00000100:00100000:3.0:1788305316.601846:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741479808 00000100:00100000:3.0:1788305316.601919:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:3.0:1788305316.601933:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10528:x1875173741479808:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788305316.602549:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602572:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602586:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602619:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602627:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602635:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602756:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602765:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602772:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305316.602825:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602840:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602847:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602855:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602861:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.602866:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602881:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602896:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305316.602899:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.602906:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602913:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8bfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602926:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602933:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602938:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602944:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.602947:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602954:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602961:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fb87f88400) 00010000:00010000:3.0:1788305316.602963:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.602966:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602983:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.602999:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.603005:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.603011:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.603015:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305316.603019:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.603025:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.603033:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305316.603035:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305316.603039:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.603045:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.603165:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10528:x1875173741479808:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1232us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.603174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 101 00000001:00080000:3.0:1788305316.621239:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788305316.621272:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788305316.640416:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.640496:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741480064 00000100:00100000:0.0:1788305316.640509:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741480064 00000100:00100000:0.0:1788305316.640576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:0.0:1788305316.640586:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+48:10531:x1875173741480064:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305316.640612:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.640636:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8c13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a587 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640719:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640735:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640746:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640788:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640794:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640798:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640969:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640989:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.640997:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.641010:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788305316.641510:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641520:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641527:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641534:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490e00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.641539:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641547:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641563:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:1.0:1788305316.641574:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305316.641579:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641586:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490e00/0x902a3611c9ae8c1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641605:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641611:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641617:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641621:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.641624:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641630:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641638:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fba21afb00) 00010000:00010000:1.0:1788305316.641641:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305316.641643:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641649:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641696:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490c00/0x902a3611c9ae8c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641724:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.641733:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305316.641736:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305316.641738:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfe00, rc 0) 00000100:00100000:1.0:1788305316.641821:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+50:10531:x1875173741480064:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1234us (1420us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788305316.641830:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:2.0:1788305316.646014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.646358:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741480192 00000100:00100000:0.0:1788305316.646372:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741480192 00000100:00100000:0.0:1788305316.646488:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:0.0:1788305316.646502:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+50:10531:x1875173741480192:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788305316.646592:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646614:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646627:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646659:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646668:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646676:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646684:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305316.646707:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646716:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646731:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305316.646735:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305316.646740:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.646747:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.646839:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+50:10531:x1875173741480192:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 340us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305316.646848:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:2.0:1788305316.649959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.650147:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741480448 00000100:00100000:3.0:1788305316.650159:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741480448 00000100:00100000:3.0:1788305316.650232:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1788305316.650244:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+50:10531:x1875173741480448:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305316.651194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+51:10531:x1875173741480448:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 948us (1244us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788305316.651205:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1788305316.697630:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305316.697794:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741480704 00000100:00100000:0.0:1788305316.697808:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741480704 00000100:00100000:0.0:1788305316.697873:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1788305316.697882:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+51:10541:x1875173741480704:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305316.697911:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305316.697914:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788305316.697943:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81490000/0x902a3611c9ae8bb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a56b expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.697965:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305316.697969:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305316.697981:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a58e expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.698559:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.698578:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.698587:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.698629:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.698655:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 51 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.698672:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761420032:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305316.698836:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305316.701238:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761420032:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305316.701279:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.701421:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.701929:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741480832 00000100:00100000:3.0:1788305316.701938:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741480832 00010000:00010000:3.0:1788305316.701980:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 52 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.702018:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788305316.702029:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+52:2347:x1875173741480832:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305316.702048:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305316.702257:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 52 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.702269:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 52 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.702291:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8c28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a587 expref: 52 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.702349:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305316.702371:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.702379:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.702386:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.702413:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305316.702492:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.702497:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305316.702520:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788305316.702720:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8c3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 53 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.702733:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 52 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305316.702738:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305316.702740:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788305316.702742:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bea00, rc 0) 00000100:00100000:0.0:1788305316.702844:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+52:10541:x1875173741480704:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4962us (5230us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788305316.702850:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:3.0:1788305316.702900:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+51:2347:x1875173741480832:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 873us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.702905:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:2.0:1788305316.705017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.705990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741481088 00000100:00100000:3.0:1788305316.706004:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741481088 00000100:00100000:3.0:1788305316.706147:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:3.0:1788305316.706169:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+51:10541:x1875173741481088:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:3.0:1788305316.706737:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.706803:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.706815:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305316.706868:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1788305316.706888:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000961fdb9e reply state 00000000165bb3fc transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.706895:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305316.707016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10541:x1875173741481088:12345-192.168.201.38@tcp:36:bash.0 Request processed in 856us (2006us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788305316.707024:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00000020:00080000:3.0:1788305316.707030:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788305316.713497:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.713689:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.713747:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741481216 00000100:00100000:3.0:1788305316.713760:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741481216 00000100:00100000:3.0:1788305316.713838:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:3.0:1788305316.713852:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10541:x1875173741481216:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305316.713881:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305316.713904:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a595 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.714011:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.714369:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.714377:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.714413:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 55 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.714422:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.714430:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.714890:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305316.714898:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.714908:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.714928:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305316.714952:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305316.714955:0:3288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.714964:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.715138:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.715148:0:5834:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:2.0:1788305316.715160:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd200/0x902a3611c9ae8c52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.715216:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 54 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.715233:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 54 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305316.715249:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761420160:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305316.715373:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305316.718842:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305316.718947:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761420160:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305316.718982:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.719138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741481344 00000100:00100000:3.0:1788305316.719146:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741481344 00010000:00010000:3.0:1788305316.719199:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 55 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.719254:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1788305316.719285:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+55:2347:x1875173741481344:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305316.719317:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305316.719324:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 55 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.719335:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 55 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.719358:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae8c44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a58e expref: 55 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.719374:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305316.719378:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.719385:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.719390:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.719408:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305316.719463:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+54:2347:x1875173741481344:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 182us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305316.719469:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00010000:00010000:2.0:1788305316.719542:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.719550:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305316.719612:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788305316.719617:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305316.719644:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.719676:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae8c59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.719688:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.719713:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305316.719716:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305316.719718:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd800, rc 0) 00000100:00100000:2.0:1788305316.719741:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+53:10541:x1875173741481216:12345-192.168.201.38@tcp:101:bash.0 Request processed in 5895us (6062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305316.719747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:1.0:1788305316.723200:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:3.0:1788305316.723219:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305316.723263:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741481600 00000100:00100000:2.0:1788305316.723277:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741481600 00000100:00100000:2.0:1788305316.723355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:2.0:1788305316.723364:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+53:10541:x1875173741481600:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1788305316.723656:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10541:x1875173741481600:12345-192.168.201.38@tcp:35:bash.0 Request processed in 293us (473us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788305316.723664:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788305316.760196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305316.760273:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741481728 00000100:00100000:2.0:1788305316.760286:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741481728 00000100:00100000:2.0:1788305316.760381:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:2.0:1788305316.760393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+54:10547:x1875173741481728:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305316.760434:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305316.760459:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a59c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.760545:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.760560:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.760592:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305316.760665:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788305316.760669:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305316.760690:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.760717:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae8c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a59c expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.760735:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a59c expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.760744:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305316.760747:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305316.760750:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c600, rc 0) 00000100:00100000:2.0:1788305316.760827:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10547:x1875173741481728:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 437us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305316.761324:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:0.0:1788305316.765561:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305316.765642:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741481856 00000100:00100000:2.0:1788305316.765654:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741481856 00000100:00100000:2.0:1788305316.765726:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:2.0:1788305316.765739:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10547:x1875173741481856:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305316.765765:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305316.765790:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5a3 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.765917:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.765935:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.765949:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.765968:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.765975:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.765982:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.766159:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.766169:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.766175:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305316.766220:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788305316.766225:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305316.766248:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.766289:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767444:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767454:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767461:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767468:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7ca00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305316.767530:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767542:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767559:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305316.767562:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305316.767569:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767575:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ca00/0x902a3611c9ae8c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767593:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767599:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767617:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767623:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305316.767626:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767633:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767642:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fb88992300) 00010000:00010000:2.0:1788305316.767644:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305316.767647:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767653:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767711:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae8c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 57 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767729:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 56 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.767737:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305316.767739:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305316.767743:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044c00, rc 0) 00000100:00100000:2.0:1788305316.767840:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10547:x1875173741481856:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2102us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305316.767858:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:1.0:1788305316.776708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.776804:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741482112 00000100:00100000:3.0:1788305316.776818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741482112 00000100:00100000:3.0:1788305316.776897:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:3.0:1788305316.776929:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10547:x1875173741482112:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305316.776957:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305316.776983:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae8c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5aa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777144:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777162:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777171:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 57 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777181:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777357:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 57 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777375:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 57 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.777389:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305316.777394:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761420288:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305316.777572:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.777582:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.777599:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761420416:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305316.777629:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e64540 going to sleep for 11 seconds 00000100:00100000:1.0:1788305316.777968:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741482240 00000100:00100000:1.0:1788305316.777975:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741482240 00010000:00010000:1.0:1788305316.778003:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 58 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.778031:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:1.0:1788305316.778040:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+58:2348:x1875173741482240:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305316.778075:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305316.778083:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 58 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.778096:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 58 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.778120:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305316.778125:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.778133:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.778147:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305316.778189:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+58:2348:x1875173741482240:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 149us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.778197:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00010000:00010000:3.0:1788305316.780486:0:5833:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.38@tcp) returned -22 from blocking AST (req@0000000084379d58 x1875173761420288) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 57 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.780520:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5a3 expref: 57 pid: 8201 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305316.780537:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761420288:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305316.780550:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761420416:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305316.780571:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305316.780576:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.780582:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305316.780590:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305316.781995:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.782346:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741482368 00000100:00100000:1.0:1788305316.782359:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741482368 00010000:00010000:1.0:1788305316.782409:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305316.782459:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:1.0:1788305316.782472:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83071c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+57:2348:x1875173741482368:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305316.782490:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305316.782496:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.782513:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.782540:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae8c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a595 expref: 57 pid: 5834 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.782557:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305316.782561:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.782571:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.782598:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.782633:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305316.782686:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.782700:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305316.782725:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:1.0:1788305316.782877:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83071c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+57:2348:x1875173741482368:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 406us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.782886:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00010000:00010000:2.0:1788305316.783083:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae8c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.783104:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.783113:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305316.783116:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305316.783119:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbde00, rc 0) 00000100:00100000:2.0:1788305316.783152:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10547:x1875173741482112:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 6226us (6468us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788305316.783160:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:0.0:1788305316.787611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.788107:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741482624 00000100:00100000:1.0:1788305316.788122:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741482624 00000100:00100000:1.0:1788305316.788198:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788305316.788212:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10547:x1875173741482624:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:1.0:1788305316.788231:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305316.788265:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb81491a00/0x902a3611c9ae8bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a580 expref: 56 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.788292:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305316.788308:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305316.788383:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10547:x1875173741482624:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 173us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.788392:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788305316.790327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305316.793527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741482752 00000100:00100000:1.0:1788305316.793548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741482752 00000100:00100000:1.0:1788305316.793636:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:1.0:1788305316.793651:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10547:x1875173741482752:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:1.0:1788305316.793775:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.793817:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305316.793829:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305316.794044:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788305316.794199:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10547:x1875173741482752:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 553us (3880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305316.794206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:0.0:1788305316.797050:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305316.797229:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741482880 00000100:00100000:2.0:1788305316.797243:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741482880 00000100:00100000:2.0:1788305316.797327:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 111 00000100:00100000:2.0:1788305316.797337:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+55:10547:x1875173741482880:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305316.797360:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305316.797383:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5b1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.797540:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.797553:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.797588:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.797600:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.797613:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305316.797616:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305316.797618:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305316.797624:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044600, rc 0) 00000100:00100000:2.0:1788305316.797683:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10547:x1875173741482880:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 348us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305316.797688:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 111 00000040:00080000:1.0:1788305317.489392:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305317.489406:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305317.489453:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788305317.489464:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305317.489613:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb438a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761420544:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305317.489745:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305317.491423:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb438a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761420544:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305317.492039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.492109:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741483008 00000100:00100000:2.0:1788305317.492119:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741483008 00000100:00080000:0.0:1788305317.492190:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305317.492214:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:2.0:1788305317.492227:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10549:x1875173741483008:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305317.492266:0:8201:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305317.492439:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10549:x1875173741483008:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 213us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.492448:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:0.0:1788305317.496405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.496965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741483136 00000100:00100000:3.0:1788305317.496980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741483136 00000100:00100000:3.0:1788305317.497049:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:3.0:1788305317.497101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10549:x1875173741483136:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788305317.497196:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497741:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497759:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497823:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497832:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497839:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497863:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497872:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497879:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305317.497923:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788305317.497928:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305317.497941:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497952:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497971:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497977:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497984:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305317.497989:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.497996:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498010:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305317.498012:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305317.498017:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498023:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8cb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498038:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498044:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498050:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498115:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305317.498124:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498131:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498408:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff96fb87f88e00) 00010000:00010000:3.0:1788305317.498410:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305317.498414:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498419:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cbb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498433:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498438:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498444:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498450:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbdc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305317.498452:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498458:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498464:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305317.498466:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305317.498476:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.498482:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.498575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10549:x1875173741483136:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 1478us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305317.498584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:0.0:1788305317.502653:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.503001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741483392 00000100:00100000:1.0:1788305317.503011:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741483392 00000100:00100000:1.0:1788305317.503103:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:1.0:1788305317.503114:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+56:10549:x1875173741483392:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305317.503144:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305317.503164:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8cc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503275:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503308:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503320:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305317.503332:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788305317.503429:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503436:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503443:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503449:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305317.503453:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503459:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503472:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305317.503474:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788305317.503479:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503485:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503537:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8cc9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b8 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503554:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:1.0:1788305317.503556:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305317.503560:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8cc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b8 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.503570:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305317.503628:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10549:x1875173741483392:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 515us (1416us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1788305317.503969:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:0.0:1788305317.511112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.511217:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741483520 00000100:00100000:2.0:1788305317.511236:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741483520 00000100:00100000:2.0:1788305317.511350:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:2.0:1788305317.511363:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10549:x1875173741483520:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305317.511413:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305317.511572:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10549:x1875173741483520:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 209us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.511581:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:0.0:1788305317.521726:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.521831:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741483776 00000100:00100000:2.0:1788305317.521847:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741483776 00000100:00100000:2.0:1788305317.521924:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:2.0:1788305317.521933:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10549:x1875173741483776:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305317.521956:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305317.521959:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305317.521987:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae8c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a59c expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.522007:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:2.0:1788305317.522011:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305317.522024:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8cde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5bf expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305317.522632:0:8201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788305317.522840:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.522873:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.522883:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.522943:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8cde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5bf expref: 59 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.522961:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5bf expref: 58 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.522968:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fb88992300) 00010000:00010000:2.0:1788305317.522971:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305317.522973:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045800, rc 0) 00000100:00100000:2.0:1788305317.523073:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+58:10549:x1875173741483776:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1120us (1336us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788305317.523081:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:0.0:1788305317.533103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.533174:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741484032 00000100:00100000:3.0:1788305317.533188:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741484032 00000100:00100000:3.0:1788305317.533257:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:3.0:1788305317.533271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+58:10549:x1875173741484032:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305317.533363:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305317.533397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5bf expref: 58 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533421:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fb88992300) 00010000:00010000:3.0:1788305317.533447:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305317.533474:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533489:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533499:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533513:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533540:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533546:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533646:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533654:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533661:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533668:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbdc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305317.533672:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533680:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533696:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305317.533699:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305317.533703:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533709:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae8cf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533719:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533731:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533737:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533752:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305317.533756:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533762:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533768:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x25cfd5b9 (ffff96fb87f88e00) 00010000:00010000:3.0:1788305317.533770:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305317.533772:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.533776:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8cfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x25cfd5b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.533852:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10549:x1875173741484032:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 586us (801us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305317.533857:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:0.0:1788305317.535349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.535406:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741484160 00000100:00100000:1.0:1788305317.535413:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741484160 00000100:00100000:1.0:1788305317.535459:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:1.0:1788305317.535469:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+57:10549:x1875173741484160:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305317.535482:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305317.535498:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8d01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.535527:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.535537:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.535547:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.535646:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.535672:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.535679:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:1.0:1788305317.535681:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305317.535683:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ee00, rc 0) 00000100:00100000:1.0:1788305317.535725:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+58:10549:x1875173741484160:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 258us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.535733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:0.0:1788305317.537315:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.537391:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741484416 00000100:00100000:2.0:1788305317.537402:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741484416 00000100:00100000:2.0:1788305317.537453:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:2.0:1788305317.537462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+58:10549:x1875173741484416:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305317.537547:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.537565:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.537601:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305317.537924:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788305317.537937:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335247882698ns, next at 336247879823ns, rc = 0 00000004:00010000:2.0:1788305317.538076:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a7ca63d reply state 000000004dd61e64 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.538088:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305317.538195:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+60:10549:x1875173741484416:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 734us (888us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788305317.538201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00010000:00010000:3.0:1788305317.539147:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.539163:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.539192:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.539198:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305317.539204:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.539212:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.539230:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:3.0:1788305317.539234:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305317.539316:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.539325:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.539424:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.539849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741484544 00000100:00100000:1.0:1788305317.539859:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741484544 00000100:00100000:1.0:1788305317.539918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:1.0:1788305317.539930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+59:10549:x1875173741484544:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305317.539951:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305317.539967:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5cd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.540014:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.540025:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.540041:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:1.0:1788305317.540043:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305317.540065:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fc00, rc 0) 00000100:00100000:1.0:1788305317.540115:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+60:10549:x1875173741484544:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 188us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.540122:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:0.0:1788305317.541042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.541132:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741484672 00000100:00100000:3.0:1788305317.541140:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741484672 00000100:00100000:3.0:1788305317.541187:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:3.0:1788305317.541197:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2350:x1875173741484672:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788305317.541537:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2350:x1875173741484672:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 341us (496us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788305317.541545:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:2.0:1788305317.543799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305317.543870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741484928 00000100:00100000:0.0:1788305317.543880:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741484928 00000100:00100000:0.0:1788305317.543931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:0.0:1788305317.543940:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+60:10549:x1875173741484928:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788305317.544180:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+61:10549:x1875173741484928:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 240us (388us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788305317.544188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:0.0:1788305317.545358:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.545411:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741485184 00000100:00100000:3.0:1788305317.545419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741485184 00000100:00100000:3.0:1788305317.545461:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:3.0:1788305317.545468:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+61:10549:x1875173741485184:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305317.545573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+61:10549:x1875173741485184:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 105us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305317.545581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:1.0:1788305317.546536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.546594:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741485312 00000100:00100000:2.0:1788305317.546601:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741485312 00000100:00100000:2.0:1788305317.546652:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:2.0:1788305317.546661:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+61:10549:x1875173741485312:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305317.546673:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305317.546705:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5d4 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.546780:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.546797:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.546811:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305317.546864:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305317.546879:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.546907:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5d4 expref: 63 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.546922:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5d4 expref: 62 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.546931:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:2.0:1788305317.546934:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788305317.546939:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044000, rc 0) 00000100:00100000:2.0:1788305317.546978:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+62:10549:x1875173741485312:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 319us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.546984:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:2.0:1788305317.548016:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305317.548080:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741485440 00000100:00100000:0.0:1788305317.548087:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741485440 00000100:00100000:0.0:1788305317.548128:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1788305317.548138:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741485440:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305317.548165:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305317.548180:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5db expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305317.548211:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a975fa5, blocks: 0x1 00010000:00010000:0.0:1788305317.548227:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1788305317.548231:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305317.548238:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 10 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.548253:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 10 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.548281:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf200, rc 0) 00000100:00100000:0.0:1788305317.548330:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2347:x1875173741485440:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 195us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305317.548335:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1788305317.549476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.549527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741485696 00000100:00100000:2.0:1788305317.549536:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741485696 00000100:00100000:2.0:1788305317.549583:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:2.0:1788305317.549593:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+62:10549:x1875173741485696:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788305317.549683:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+62:10549:x1875173741485696:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.549691:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:1.0:1788305317.552036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.552132:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741485824 00000100:00100000:2.0:1788305317.552144:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741485824 00000100:00100000:2.0:1788305317.552219:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788305317.552231:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+10:10549:x1875173741485824:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305317.552253:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305317.552276:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5e2 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.552328:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.552338:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305317.552345:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305317.552351:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.552395:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.552411:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.552429:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875173761420672:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305317.552552:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305317.553707:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875173761420672:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305317.553752:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305317.553781:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:2.0:1788305317.553803:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044e00, rc 0) 00000100:00100000:0.0:1788305317.553847:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741485952 00000100:00100000:0.0:1788305317.553856:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741485952 00000100:00100000:2.0:1788305317.553862:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+11:10549:x1875173741485824:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1631us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.553871:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00010000:00010000:0.0:1788305317.553897:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.553932:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:0.0:1788305317.553943:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+11:2347:x1875173741485952:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305317.553957:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305317.553990:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.554006:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.554031:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8aa7b92/0x902a3611c9ae8d2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5db expref: 11 pid: 6677 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.554046:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305317.554085:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305317.554110:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.554125:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.554175:0:8499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.554188:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8499:1875173761420800:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788305317.554238:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305317.557222:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8499:1875173761420800:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788305317.557223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:0.0:1788305317.557258:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305317.557349:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2347:x1875173741485952:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 3408us (3571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305317.557363:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:2.0:1788305317.557385:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741486080 00000100:00100000:2.0:1788305317.557395:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741486080 00002000:00100000:2.0:1788305317.557454:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff96fbbb438000 x1875173741486080/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:248/0 lens 504/0 e 0 to 0 dl 1788305328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305317.557467:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbbb438000 with x1875173741486080 ext(0->12) 00002000:00010000:2.0:1788305317.557473:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbbb438000 00000100:00100000:2.0:1788305317.557506:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1788305317.557516:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2350:x1875173741486080:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788305317.558452:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+12:2350:x1875173741486080:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 932us (1234us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788305317.558463:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00002000:00100000:2.0:1788305317.558472:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff96fbbb438000 x1875173741486080/t4294967308(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:248/0 lens 504/448 e 0 to 0 dl 1788305328 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305317.558482:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbbb438000 with x1875173741486080 ext(0->12) 00002000:00010000:2.0:1788305317.558487:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbbb438000 00000100:00100000:1.0:1788305317.560018:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.560084:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741486208 00000100:00100000:2.0:1788305317.560096:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741486208 00000100:00100000:2.0:1788305317.560163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:2.0:1788305317.560175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+62:10549:x1875173741486208:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788305317.581893:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:0.0:1788305317.581933:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788305317.581972:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fb93fb7600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788305317.581979:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fa82614a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fb93fb7480 00000020:00080000:0.0:1788305317.581983:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fa82614000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fbb996a000 00000004:00080000:0.0:1788305317.582044:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788305317.582047:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000100:00100000:3.0:1788305317.582080:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+34:10549:x1875173741486208:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 21869us (22032us total) trans 0 rc 0/0 00000004:00080000:0.0:1788305317.582090:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1788305317.582112:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000020:00080000:0.0:1788305317.582112:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fba2116900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788305317.582119:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fbaf7af200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fba2425cc0 00000020:00080000:0.0:1788305317.582135:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fbaf7af300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fbbb602800 00000020:00080000:0.0:1788305317.582150:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788305317.582194:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761420928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788305317.582271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305317.582295:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761421056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788305317.582344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305317.582349:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761421184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788305317.582386:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761420928 00000100:00100000:0.0:1788305317.582395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305317.582397:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761420928 00000020:00080000:1.0:1788305317.582398:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1788305317.582423:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761421056 00000100:00100000:2.0:1788305317.582429:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761421056 00000100:00080000:0.0:1788305317.582439:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788305317.582449:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788305317.582483:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761421184 00000100:00100000:3.0:1788305317.582487:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761421184 00000100:00100000:2.0:1788305317.582488:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305317.582499:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305317.582503:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761420928:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788305317.582523:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875173761421056:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:2.0:1788305317.582541:0:11977:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788305317.582571:0:11977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.582594:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.582605:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788305317.582610:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305317.582616:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.582649:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.582663:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 11 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.582672:0:11977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761421312:192.168.201.38@tcp:104: 00002000:00010000:1.0:1788305317.582684:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788305317.582689:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788305317 00002000:00010000:1.0:1788305317.582693:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788305317.582695:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788305317 -> 1788305317 00002000:00010000:1.0:1788305317.582708:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788305317.582736:0:11977:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305317.582760:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1875173761421056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (417us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788305317.582769:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788305317.582796:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788305317.582804:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761421184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788305317.582817:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788305317.582843:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a975fa4, atime: 0x6a975fa4, ctime: 0x6a975fa4, blocks: 0xb 00010000:00010000:1.0:1788305317.582850:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.582866:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1788305317.582869:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305317.582876:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.582893:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.582905:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305317.582920:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fbb9bf0380/2, rc 0, transno 4294967309 00010000:00010000:1.0:1788305317.582925:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.582929:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761421056:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788305317.582956:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305317.582989:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305317.582997:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.583009:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305317.583015:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.583027:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.583048:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.583083:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae8d40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.583107:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305317.583110:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305317.583113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305317.583536:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761421184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 732us (1142us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788305317.583544:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305317.583566:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788305317.583573:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1788305317.583599:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fbaf58df80, transno 4294967301 00000004:00080000:0.0:1788305317.583613:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1788305317.583639:0:3301:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff96fbb9bf0a80 x1875173761421184/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305333 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788305317.583649:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fbb9bf0a80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788305317.583653:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761421184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788305317.584965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.584995:0:11977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761421312:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305317.585025:0:11977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305317.585103:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741486336 00000100:00100000:1.0:1788305317.585112:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741486336 00000100:00100000:3.0:1788305317.585159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305317.585205:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741486464 00000100:00100000:0.0:1788305317.585210:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741486464 00010000:00010000:0.0:1788305317.585240:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 13 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305317.585246:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:1.0:1788305317.585262:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:2350:x1875173741486336:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788305317.585297:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1788305317.585309:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+13:2348:x1875173741486464:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305317.585321:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305317.585328:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 13 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585345:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 13 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585370:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae8afb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a541 expref: 13 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585387:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305317.585392:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305317.585409:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585419:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585453:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305317.585503:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+12:2348:x1875173741486464:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 198us (344us total) trans 0 rc 0/0 00010000:00010000:3.0:1788305317.585511:0:11977:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.585512:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00010000:00010000:3.0:1788305317.585525:0:11977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.585537:0:11977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.585546:0:11977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.585595:0:11977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305317.585733:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305317.585746:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585757:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305317.585762:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585772:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585787:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585795:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae8d39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.585840:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305317.585843:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305317.585846:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305317.586908:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1875173761420928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4404us (4633us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788305317.586918:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1788305317.586975:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fbb9bf2d80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788305317.586983:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761420928:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788305317.599134:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788305317.599160:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788305317.599168:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788305317.599239:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741486336:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 13973us (14275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.599254:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:3.0:1788305317.601049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305317.601108:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741486720 00000100:00100000:0.0:1788305317.601119:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741486720 00000100:00100000:0.0:1788305317.601180:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1788305317.601189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:10549:x1875173741486720:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788305317.601255:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305317.601299:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5d4 expref: 15 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.601322:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:0.0:1788305317.601329:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305317.601368:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.601385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.601405:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305317.601737:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007785ae5a reply state 00000000eb3cd258 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.601749:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305317.601854:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+16:10549:x1875173741486720:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 665us (811us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788305317.601879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00010000:00010000:1.0:1788305317.602622:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.602633:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.602641:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.602648:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305317.602654:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.602663:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.602677:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:1.0:1788305317.602680:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305317.602685:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.602691:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae8d47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.602863:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.602915:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741486848 00000100:00100000:1.0:1788305317.602925:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741486848 00000100:00100000:1.0:1788305317.602973:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1788305317.602985:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741486848:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788305317.603206:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788305317.603210:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788305317 -> 1788305316 00002000:00010000:1.0:1788305317.603213:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788305316 00002000:00010000:1.0:1788305317.603224:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788305317 -> 1788305316 00002000:00010000:1.0:1788305317.603226:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788305317.603264:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741486848:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 282us (403us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788305317.603270:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:0.0:1788305317.605793:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.606240:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741487104 00000100:00100000:2.0:1788305317.606254:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741487104 00000100:00100000:2.0:1788305317.606341:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:2.0:1788305317.606355:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+15:10549:x1875173741487104:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788305317.606615:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.606635:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.606645:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.606688:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.606705:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 15 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.606722:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761421440:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305317.606842:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305317.609767:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761421440:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305317.609807:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.609924:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.610005:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741487232 00000100:00100000:3.0:1788305317.610015:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741487232 00010000:00010000:3.0:1788305317.610090:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.610153:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:0.0:1788305317.610166:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+16:2348:x1875173741487232:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305317.610186:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305317.610195:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.610210:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.610250:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5c6 expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.610269:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:0.0:1788305317.610275:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.610295:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.610304:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.610354:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305317.610371:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.610380:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.610411:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.610418:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+15:2348:x1875173741487232:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 254us (493us total) trans 0 rc 0/0 00010000:00010000:1.0:1788305317.610429:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.610433:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00010000:00010000:1.0:1788305317.610439:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.610445:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305317.610449:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.610454:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.610463:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:1.0:1788305317.610466:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788305317.610470:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.610489:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305317.610551:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10549:x1875173741487104:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 4199us (4769us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788305317.610562:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:2.0:1788305317.614034:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.614102:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741487360 00000100:00100000:3.0:1788305317.614115:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741487360 00000100:00100000:3.0:1788305317.614186:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1788305317.614204:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741487360:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788305317.614261:0:11977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.614304:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.614316:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305317.614321:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305317.614338:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.614383:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.614400:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 7 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.614531:0:11977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761421568:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305317.614984:0:11977:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb852c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305317.616175:0:11977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761421568:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305317.616217:0:11977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.616905:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.617312:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741487488 00000100:00100000:3.0:1788305317.617322:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741487488 00010000:00010000:3.0:1788305317.617370:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 8 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.617406:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788305317.617417:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741487488:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305317.617433:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305317.617458:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 8 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.617472:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 8 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.617502:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae8d32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e2 expref: 8 pid: 6675 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.617535:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305317.617538:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305317.617544:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.617554:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305317.617590:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305317.617614:0:11977:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.617627:0:11977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.617653:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741487488:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 237us (752us total) trans 0 rc 0/0 00010000:00010000:2.0:1788305317.617662:0:11977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305317.617663:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00010000:00010000:2.0:1788305317.617675:0:11977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.617685:0:11977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.617705:0:11977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbdc00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305317.617711:0:11977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.617735:0:11977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.617760:0:11977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.617766:0:11977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac613f1/0x902a3611c9ae8d55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.617829:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741487360:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 3634us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.617838:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1788305317.623459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305317.623781:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741487744 00000100:00100000:0.0:1788305317.623796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741487744 00000100:00100000:0.0:1788305317.623879:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:0.0:1788305317.623892:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10549:x1875173741487744:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788305317.624004:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624028:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624041:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624374:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624387:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624396:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624440:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.624481:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 15 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.624500:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761421696:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305317.624809:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305317.630331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305317.630331:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761421696:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305317.630371:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.630421:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741487872 00000100:00100000:2.0:1788305317.630432:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741487872 00010000:00010000:2.0:1788305317.630482:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.630532:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:2.0:1788305317.630544:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+16:2348:x1875173741487872:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305317.630562:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305317.630571:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.630584:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.630638:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5cd expref: 16 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.630657:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:2.0:1788305317.630670:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.630681:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.630689:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.630724:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305317.630802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+15:2348:x1875173741487872:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 258us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305317.630810:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00010000:00010000:0.0:1788305317.632151:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.632167:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305317.632481:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788305317.632681:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788305317.632754:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788305317.632854:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875173761421824:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788305317.632927:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305317.632962:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305317.632999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761421824 00000100:00100000:1.0:1788305317.633008:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761421824 00000100:00100000:1.0:1788305317.633091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305317.633102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875173761421824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788305317.633255:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875173761421824:12345-0@lo:1000:mdt00_000.0 Request processed in 154us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.633265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305317.633344:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788305317.633350:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788305317.633377:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fbb9bf0380, transno 4294967309 00000100:00100000:2.0:1788305317.633399:0:5832:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff96fbb9bf2d80 x1875173761420928/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305333 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305317.633413:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875173761421824:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788305317.634047:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788305317.634133:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875173761421952:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788305317.634177:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305317.634208:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305317.634217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761421952 00000100:00100000:0.0:1788305317.634225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761421952 00000100:00100000:0.0:1788305317.634265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305317.634272:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875173761421952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788305317.634441:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1875173761421952:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (263us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788305317.634460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305317.634477:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875173761421952:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788305317.634522:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634533:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634542:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634548:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bfe00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305317.634553:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634561:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634584:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fbb5e39600) 00010000:00010000:2.0:1788305317.634587:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305317.634592:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634599:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae8d63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634635:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634641:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634647:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634658:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305317.634662:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634668:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634676:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305317.634678:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305317.634686:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634708:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634718:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.634960:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.634974:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761422080:192.168.201.38@tcp:105: 00000100:00100000:2.0:1788305317.635078:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305317.637826:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761422080:192.168.201.38@tcp:105: 00010000:00010000:2.0:1788305317.637867:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.637913:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8ca6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.637955:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.637973:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.637985:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.637998:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638005:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638013:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638019:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305317.638024:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638032:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638047:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305317.638079:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305317.638084:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638098:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638111:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638118:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638132:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638138:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305317.638141:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638147:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638157:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:2.0:1788305317.638160:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305317.638163:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.638168:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae8d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305317.638592:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305317.638599:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305317.639149:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788305317.639160:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788305317.639342:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10549:x1875173741487744:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 15448us (15894us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1788305317.639355:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000020:00080000:2.0:1788305317.639369:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788305317.641029:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.641226:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741488000 00000100:00100000:1.0:1788305317.641237:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741488000 00000100:00100000:1.0:1788305317.641304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:1.0:1788305317.641316:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10547:x1875173741488000:12345-192.168.201.38@tcp:49:lfs.0 00000100:00100000:1.0:1788305317.641484:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10547:x1875173741488000:12345-192.168.201.38@tcp:49:lfs.0 Request processed in 170us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.641493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:1.0:1788305317.644944:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305317.645006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741488256 00000100:00100000:2.0:1788305317.645024:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741488256 00000100:00100000:2.0:1788305317.645128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1788305317.645141:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:10549:x1875173741488256:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788305317.646030:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788305317.646196:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1788305317.646255:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.646275:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.646300:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.646310:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.646317:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.646324:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.646347:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305317.646381:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305317.646397:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.646415:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044c00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305317.646420:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.646430:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.646447:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96fb88992d00) 00010000:00010000:1.0:1788305317.646451:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788305317.646456:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.646467:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10549:x1875173741488256:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1327us (1535us total) trans 4294967409 rc 0/0 00010000:00010000:1.0:1788305317.646477:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae8d71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.646480:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000020:00080000:2.0:1788305317.646489:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788305317.646504:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305317.646508:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305317.646511:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305317.646554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.646597:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741488512 00000100:00100000:1.0:1788305317.646604:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741488512 00000100:00100000:1.0:1788305317.646651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:1.0:1788305317.646660:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10547:x1875173741488512:12345-192.168.201.38@tcp:58:lfs.0 00000040:00080000:1.0:1788305317.646856:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788305317.646902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10547:x1875173741488512:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 245us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.646908:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:0.0:1788305317.663938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.664008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741488640 00000100:00100000:3.0:1788305317.664023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741488640 00000100:00100000:2.0:1788305317.664173:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1788305317.664187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:10551:x1875173741488640:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305317.664224:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305317.664248:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5e9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664344:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664362:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664376:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664394:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664401:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664408:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664835:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664849:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664858:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664906:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305317.664918:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 21 pid: 5833 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305317.664939:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9bf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761422208:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305317.665027:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305317.668587:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9bf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761422208:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305317.668627:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305317.668840:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305317.668946:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741488896 00000100:00100000:3.0:1788305317.668955:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741488896 00000100:00100000:3.0:1788305317.669024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1788305317.669035:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+22:5588:x1875173741488896:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788305317.669420:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+23:5588:x1875173741488896:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 384us (579us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788305317.669429:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1788305317.673583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305317.673667:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741489024 00000100:00100000:1.0:1788305317.673682:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741489024 00010000:00010000:1.0:1788305317.673758:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 23 pid: 5833 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305317.673969:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:1.0:1788305317.673982:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83070050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+23:2347:x1875173741489024:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305317.674003:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305317.674013:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 23 pid: 5833 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.674030:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 23 pid: 5833 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.674082:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae8c98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5aa expref: 23 pid: 5833 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.674102:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305317.674107:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.674115:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.674122:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305317.674152:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305317.674231:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83070050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+22:2347:x1875173741489024:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 251us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305317.674239:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00010000:00010000:0.0:1788305317.674388:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674396:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305317.674450:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788305317.674457:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305317.674482:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674495:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674504:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674508:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674514:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674520:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044e00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305317.674544:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674554:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674565:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:0.0:1788305317.674567:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305317.674571:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674576:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8d7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674590:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674597:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674603:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674609:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305317.674613:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674619:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674627:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96fb88992300) 00010000:00010000:0.0:1788305317.674629:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305317.674638:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674688:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045c00/0x902a3611c9ae8d78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e9 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674704:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e9 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305317.674712:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305317.674715:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305317.674717:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044000, rc 0) 00000100:00100000:0.0:1788305317.674765:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+21:10551:x1875173741488640:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 10582us (10851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305317.674773:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00010000:00010000:3.0:1788305317.745242:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305318.383359:0:12095:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305318.383373:0:12095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305318.384436:0:12095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788305318.384449:0:12095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788305318.641348:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305318.641357:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305318.641393:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788305318.641405:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305318.641531:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb43b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761422336:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305318.641789:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb889f5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305318.658571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305318.658842:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb43b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761422336:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305318.659103:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741489152 00000100:00100000:3.0:1788305318.659112:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741489152 00000100:00100000:3.0:1788305318.659178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:3.0:1788305318.659189:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+21:10563:x1875173741489152:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788305318.659261:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788305318.659372:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+21:10563:x1875173741489152:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 184us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305318.659380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:3.0:1788305318.664206:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305318.664318:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741489408 00000100:00100000:0.0:1788305318.664328:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741489408 00000100:00100000:0.0:1788305318.664390:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:0.0:1788305318.664401:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:10563:x1875173741489408:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305318.664422:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305318.664442:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8d94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5f0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305318.664551:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305318.664580:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305318.664592:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305318.664605:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788305318.664784:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8d94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5f0 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305318.664802:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5f0 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305318.664810:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305318.664813:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305318.664816:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfc00, rc 0) 00000100:00100000:0.0:1788305318.664876:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:10563:x1875173741489408:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 477us (679us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788305318.664883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:2.0:1788305318.678611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305318.678717:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741489664 00000100:00100000:3.0:1788305318.678727:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741489664 00000100:00100000:3.0:1788305318.678896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:3.0:1788305318.678908:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+23:10563:x1875173741489664:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788305318.678995:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679013:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679025:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679284:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679292:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679312:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679318:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305318.679323:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679331:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679343:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305318.679346:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305318.679350:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305318.679356:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8da9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305318.679732:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305318.679737:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305318.680278:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788305318.680288:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305318.680728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+24:10563:x1875173741489664:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 1818us (2121us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788305318.680739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:1.0:1788305318.687630:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305318.687718:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305318.687908:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490048 00000100:00100000:0.0:1788305318.687917:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490048 00000100:00100000:0.0:1788305318.687983:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788305318.687994:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+24:2348:x1875173741490048:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305318.688009:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305318.688034:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5f0 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305318.688100:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305318.688106:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305318.688165:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+23:2348:x1875173741490048:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 173us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305318.688174:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1788305318.689675:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741489920 00000100:00100000:3.0:1788305318.689687:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741489920 00000100:00100000:3.0:1788305318.689753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1788305318.689762:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+23:10563:x1875173741489920:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788305318.691701:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+24:10563:x1875173741489920:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1928us (4069us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788305318.691714:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00010000:00010000:1.0:1788305318.770998:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305319.561960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305319.562182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305319.562221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305319.562264:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305319.562295:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490304 00000100:00100000:3.0:1788305319.562305:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490304 00000100:00100000:3.0:1788305319.562362:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490432 00000100:00100000:3.0:1788305319.562366:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490432 00000100:00100000:3.0:1788305319.562388:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1788305319.562413:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741490304:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305319.562493:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741490304:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 95us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305319.562508:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1788305319.562524:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1788305319.562531:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741490432:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305319.562557:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741490432:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.562679:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490176 00000100:00100000:0.0:1788305319.562684:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490176 00000100:00100000:0.0:1788305319.562719:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 289 00000100:00100000:0.0:1788305319.562727:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741490176:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305319.562757:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741490176:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.562763:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 289 00000100:00080000:0.0:1788305319.562813:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305319.562818:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305319.562830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490560 00000100:00100000:0.0:1788305319.562833:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490560 00000100:00100000:0.0:1788305319.562868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:0.0:1788305319.562876:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741490560:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305319.562906:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2350:x1875173741490560:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.562912:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00080000:0.0:1788305319.562930:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305319.566513:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:0.0:1788305319.665475:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305319.665512:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761422464:0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.665596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305319.665730:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761422592:0@lo:400:kworker.0 00000100:00100000:2.0:1788305319.665740:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761422720:0@lo:400:kworker.0 00000100:00100000:1.0:1788305319.665769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305319.665795:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761422976:0@lo:400:kworker.0 00000100:00100000:1.0:1788305319.665799:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761423104:0@lo:400:kworker.0 00000100:00100000:2.0:1788305319.665806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305319.665869:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761422464 00000100:00100000:3.0:1788305319.665877:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761422464 00000100:00100000:3.0:1788305319.665940:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788305319.665951:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761422464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305319.666199:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305319.666205:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761422848:0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305319.666277:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761422592 00000100:00100000:0.0:1788305319.666282:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761422592 00000100:00100000:0.0:1788305319.666312:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761422720 00000100:00100000:0.0:1788305319.666361:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761422720 00000100:00100000:0.0:1788305319.666392:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761422976 00000100:00100000:0.0:1788305319.666395:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761422976 00000100:00100000:0.0:1788305319.666412:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788305319.666418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761422592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666458:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761422592:12345-0@lo:400:kworker.0 Request processed in 40us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.666466:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788305319.666483:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788305319.666489:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761422720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666530:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761422720:12345-0@lo:400:kworker.0 Request processed in 41us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.666536:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788305319.666549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788305319.666565:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761422976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761422976:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.666607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788305319.666626:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761422848 00000100:00100000:0.0:1788305319.666638:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761422848 00000100:00100000:0.0:1788305319.666670:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305319.666678:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875173761422848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666710:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875173761422848:12345-0@lo:400:kworker.0 Request processed in 34us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305319.666717:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788305319.666737:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305319.666741:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305319.666774:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761422848:0@lo:400:kworker.0 00000100:00100000:0.0:1788305319.666786:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761422976:0@lo:400:kworker.0 00000100:00100000:2.0:1788305319.669474:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761422720:0@lo:400:kworker.0 00000100:00100000:1.0:1788305319.670997:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305319.671075:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423104 00000100:00100000:2.0:1788305319.671085:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423104 00000100:00100000:3.0:1788305319.671090:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761422464:12345-0@lo:400:kworker.0 Request processed in 5138us (5490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305319.671103:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788305319.671116:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761422464:0@lo:400:kworker.0 00000100:00080000:0.0:1788305319.671143:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305319.671164:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788305319.671190:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761423104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305319.671239:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761422592:0@lo:400:kworker.0 00000100:00100000:3.0:1788305319.671244:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761423104:12345-0@lo:400:kworker.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305319.671262:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788305319.671273:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761423104:0@lo:400:kworker.0 00010000:00010000:2.0:1788305319.794326:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305320.178291:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305320.178314:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761423232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305320.178379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305320.178525:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423232 00000100:00100000:0.0:1788305320.178534:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423232 00000100:00100000:0.0:1788305320.178586:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305320.178597:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761423232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305320.178633:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305320.178704:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761423232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305320.178712:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305320.178736:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761423360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305320.178774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305320.178776:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761423232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305320.178833:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423360 00000100:00100000:0.0:1788305320.178838:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423360 00000100:00100000:0.0:1788305320.178878:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788305320.178886:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761423360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305320.178920:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305320.178958:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761423360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305320.178965:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788305320.178999:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761423360:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788305320.225841:0:12146:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305320.225850:0:12146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305320.225897:0:12146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788305320.225908:0:12146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305320.444732:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305320.444987:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490816 00000100:00100000:1.0:1788305320.445757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490816 00000100:00100000:0.0:1788305320.445882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:0.0:1788305320.445905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+24:10584:x1875173741490816:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305320.445935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305320.445955:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8db0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5f7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305320.446073:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae8db7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305320.446088:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae8db7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305320.446100:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae8db7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305320.446111:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788305320.446244:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8db0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5f7 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305320.446265:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae8db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5f7 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305320.446291:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:0.0:1788305320.446294:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788305320.446298:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be400, rc 0) 00000100:00100000:0.0:1788305320.446360:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+26:10584:x1875173741490816:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 468us (1644us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788305320.446367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00080000:1.0:1788305320.446750:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305320.451959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305320.452188:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741490944 00000100:00100000:1.0:1788305320.452199:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741490944 00000100:00100000:1.0:1788305320.452372:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:1.0:1788305320.452385:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+26:10584:x1875173741490944:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788305320.452491:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452509:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452521:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452548:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452555:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452562:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452567:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305320.452572:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452579:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452591:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:1.0:1788305320.452595:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305320.452600:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305320.452621:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae8dc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305320.452797:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+26:10584:x1875173741490944:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 414us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305320.452806:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:0.0:1788305320.557853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305320.558133:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491072 00000100:00100000:2.0:1788305320.558146:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491072 00000100:00100000:2.0:1788305320.558214:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1788305320.558224:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741491072:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1788305320.558295:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305320.558317:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdde6afd/0x902a3611c9ae8dcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a5fe expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305320.558346:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a975fa4, atime: 0x6a975fa4, ctime: 0x6a975fa4, blocks: 0xb 00010000:00010000:2.0:1788305320.558366:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788305320.558370:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305320.558381:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdde6afd/0x902a3611c9ae8dcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5fe expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305320.558401:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdde6afd/0x902a3611c9ae8dcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5fe expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305320.558415:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045c00, rc 0) 00000100:00100000:2.0:1788305320.558482:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741491072:12345-192.168.201.38@tcp:101:cat.0 Request processed in 259us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305320.558489:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:0.0:1788305320.570040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305320.570225:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491200 00000100:00100000:3.0:1788305320.570244:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491200 00002000:00100000:3.0:1788305320.570298:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff96fbc1318000 x1875173741491200/t0(0) o3->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:251/0 lens 488/0 e 0 to 0 dl 1788305331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305320.570310:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc1318000 with x1875173741491200 ext(0->4095) 00002000:00010000:3.0:1788305320.570316:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbc1318000 00000100:00100000:3.0:1788305320.570349:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1788305320.570360:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741491200:12345-192.168.201.38@tcp:3:cat.0 00000100:00100000:3.0:1788305320.570712:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741491200:12345-192.168.201.38@tcp:3:cat.0 Request processed in 352us (682us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788305320.570719:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00002000:00100000:3.0:1788305320.570726:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff96fbc1318000 x1875173741491200/t0(0) o3->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:251/0 lens 488/4536 e 0 to 0 dl 1788305331 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305320.570735:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc1318000 with x1875173741491200 ext(0->4095) 00002000:00010000:3.0:1788305320.570738:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbc1318000 00010000:00010000:1.0:1788305320.817375:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788305321.798018:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1788305321.841577:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788305322.796488:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788305322.796521:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788305322.796528:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:0.0:1788305322.796553:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fb88a5ac00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788305322.796559:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fbaf7afe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fb88a5a780 00000020:00080000:0.0:1788305322.796562:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fbaf7af900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fa81d03800 00000020:00080000:3.0:1788305322.796720:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788305322.796875:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788305322.804229:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788305322.804372:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1788305322.865179:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305323.891501:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305324.698558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305324.698613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305324.698651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305324.698685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305324.698708:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305324.698805:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491712 00000100:00100000:2.0:1788305324.698816:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491712 00000100:00100000:2.0:1788305324.698886:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491584 00000100:00100000:2.0:1788305324.698889:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491584 00000100:00100000:3.0:1788305324.698915:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491328 00000100:00100000:2.0:1788305324.698921:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1788305324.698922:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491328 00000100:00100000:2.0:1788305324.698934:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741491712:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305324.698961:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 291 00000100:00100000:3.0:1788305324.698985:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741491328:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305324.699009:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741491712:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 76us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305324.699035:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741491328:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305324.699038:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1788305324.699049:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 291 00000100:00100000:2.0:1788305324.699113:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:2.0:1788305324.699124:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741491584:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305324.699153:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741491584:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305324.699171:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00080000:1.0:1788305324.699236:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305324.699241:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305324.699428:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491456 00000100:00100000:0.0:1788305324.699434:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491456 00000100:00100000:0.0:1788305324.699490:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491840 00000100:00100000:0.0:1788305324.699494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491840 00000100:00100000:0.0:1788305324.699520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:0.0:1788305324.699527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:2347:x1875173741491456:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305324.699558:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:2347:x1875173741491456:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305324.699564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:0.0:1788305324.699595:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:0.0:1788305324.699601:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741491840:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305324.699630:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741491840:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305324.699637:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00080000:1.0:1788305324.699819:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305324.789071:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761423872:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789172:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305324.789254:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305324.789274:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761423488:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305324.789334:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761424000:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305324.789388:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761423744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305324.789431:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788305324.789437:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761423616:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305324.789479:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761424128:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305324.789526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424000 00000100:00100000:0.0:1788305324.789533:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424000 00000100:00100000:0.0:1788305324.789575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423744 00000100:00100000:0.0:1788305324.789577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423744 00000100:00100000:0.0:1788305324.789589:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423616 00000100:00100000:0.0:1788305324.789591:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423616 00000100:00100000:0.0:1788305324.789604:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788305324.789627:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761424000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761424000:12345-0@lo:400:kworker.0 Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305324.789683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788305324.789700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788305324.789705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761423744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789732:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761423744:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305324.789738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788305324.789748:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788305324.789754:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761423616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761423616:12345-0@lo:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305324.789783:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788305324.789815:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761423616:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789823:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761423744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305324.789851:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761424000:0@lo:400:kworker.0 00000100:00080000:1.0:1788305324.789956:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305324.790082:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423488 00000100:00100000:3.0:1788305324.790087:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423488 00000100:00100000:3.0:1788305324.790115:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788305324.790122:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761423488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305324.790181:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761423488:12345-0@lo:400:kworker.0 Request processed in 59us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305324.790188:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788305324.790218:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761423872 00000100:00100000:3.0:1788305324.790221:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761423872 00000100:00100000:3.0:1788305324.790252:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424128 00000100:00100000:3.0:1788305324.790255:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424128 00000100:00100000:3.0:1788305324.790277:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788305324.790284:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761423872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305324.790314:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761423872:12345-0@lo:400:kworker.0 Request processed in 31us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305324.790320:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788305324.790330:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788305324.790336:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761424128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305324.790367:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761424128:12345-0@lo:400:kworker.0 Request processed in 31us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305324.790373:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788305324.790395:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305324.790405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305324.790423:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788305324.790428:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fbb9bf0a80, transno 4294967304 00000100:00100000:3.0:1788305324.790438:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761424128:0@lo:400:kworker.0 00000100:00100000:1.0:1788305324.790514:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761423488:0@lo:400:kworker.0 00000100:00100000:1.0:1788305324.790525:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788305324.790529:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fbb9bf2d80, transno 4294967310 00000004:00080000:1.0:1788305324.790548:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788305324.790564:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761423872:0@lo:400:kworker.0 00010000:00010000:1.0:1788305324.917086:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305325.299280:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761424256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305325.299365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305325.299570:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424256 00000100:00100000:1.0:1788305325.299579:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424256 00000100:00100000:1.0:1788305325.299633:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305325.299643:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761424256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305325.299684:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305325.299728:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761424256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305325.299736:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305325.299818:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761424256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305325.303228:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761424384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305325.303304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305325.303406:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424384 00000100:00100000:3.0:1788305325.303413:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424384 00000100:00100000:3.0:1788305325.303461:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305325.303470:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761424384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305325.303504:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305325.303549:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761424384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305325.303556:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305325.303598:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761424384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305325.928934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305325.929043:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741491968 00000100:00100000:0.0:1788305325.929079:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741491968 00000100:00100000:0.0:1788305325.929164:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:0.0:1788305325.929176:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10227:x1875173741491968:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788305325.929277:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10227:x1875173741491968:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 103us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305325.929285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 135 00010000:00010000:2.0:1788305325.937288:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305325.950034:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305325.950591:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492224 00000100:00100000:1.0:1788305325.950602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492224 00000100:00100000:1.0:1788305325.950671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1788305325.950683:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:10227:x1875173741492224:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788305325.951546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+14:10227:x1875173741492224:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 862us (1522us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788305325.951556:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1788305326.256604:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305326.256738:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492352 00000100:00100000:3.0:1788305326.256750:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492352 00000100:00100000:3.0:1788305326.256872:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:3.0:1788305326.256886:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:11037:x1875173741492352:12345-192.168.201.38@tcp:101:lsof.0 00010000:00010000:3.0:1788305326.256909:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305326.256931:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8dd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a605 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305326.256996:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305326.257026:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305326.257037:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305326.260417:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788305326.260432:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305326.260697:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305326.260743:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8dd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 7 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305326.260768:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 6 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305326.260779:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:3.0:1788305326.260782:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305326.260786:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd000, rc 0) 00000100:00100000:3.0:1788305326.260884:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:11037:x1875173741492352:12345-192.168.201.38@tcp:101:lsof.0 Request processed in 3999us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305326.260893:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00080000:1.0:1788305326.261473:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788305326.897360:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305326.897370:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305326.897782:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788305326.897790:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788305326.961929:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788305327.923424:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788305327.923449:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788305327.923500:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788305327.923525:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788305327.985196:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305329.009535:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305329.801648:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305329.801726:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305329.801753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305329.801770:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305329.801790:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305329.805613:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492864 00000100:00100000:1.0:1788305329.805642:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492864 00000100:00100000:1.0:1788305329.805704:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492736 00000100:00100000:1.0:1788305329.805708:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492736 00000100:00100000:1.0:1788305329.805736:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:1.0:1788305329.805748:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741492864:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305329.805824:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2350:x1875173741492864:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 79us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305329.805831:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:1.0:1788305329.805846:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:1.0:1788305329.805852:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741492736:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305329.805871:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2350:x1875173741492736:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 20us (4101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305329.805877:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:1.0:1788305329.805892:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492480 00000100:00100000:1.0:1788305329.805896:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492480 00000100:00100000:1.0:1788305329.805917:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 293 00000100:00100000:1.0:1788305329.805923:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741492480:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305329.805942:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2350:x1875173741492480:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 19us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305329.805948:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 293 00000100:00080000:1.0:1788305329.805973:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305329.805976:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305329.810793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492608 00000100:00100000:2.0:1788305329.810793:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741492992 00000100:00100000:3.0:1788305329.810807:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492608 00000100:00100000:2.0:1788305329.810807:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741492992 00000100:00080000:1.0:1788305329.810912:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305329.810965:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:3.0:1788305329.810977:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:2350:x1875173741492608:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305329.811011:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:2.0:1788305329.811020:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2350:x1875173741492992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305329.811123:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+13:2350:x1875173741492608:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 148us (9484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305329.811132:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:2.0:1788305329.811164:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2350:x1875173741492992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 145us (9372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305329.811171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:3.0:1788305329.907779:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761424896:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.907853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305329.907915:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305329.908141:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761424512:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305329.908247:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761425024:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305329.908319:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761424640:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305329.908371:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761425152:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305329.908414:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305329.908419:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761424768:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908441:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305329.908471:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424896 00000100:00100000:3.0:1788305329.908478:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424896 00000100:00100000:3.0:1788305329.908525:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425152 00000100:00100000:3.0:1788305329.908529:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425152 00000100:00100000:3.0:1788305329.908576:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788305329.908585:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761424896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908634:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761424896:12345-0@lo:400:kworker.0 Request processed in 51us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305329.908641:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788305329.908656:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788305329.908662:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761425152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908697:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761425152:12345-0@lo:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305329.908702:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788305329.908718:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425024 00000100:00100000:3.0:1788305329.908722:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425024 00000100:00100000:3.0:1788305329.908758:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424640 00000100:00100000:3.0:1788305329.908762:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424640 00000100:00100000:3.0:1788305329.908771:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424768 00000100:00100000:3.0:1788305329.908774:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424768 00000100:00100000:3.0:1788305329.908786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305329.908791:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761425024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908823:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761425024:12345-0@lo:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305329.908828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305329.908840:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788305329.908846:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761424640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.908872:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761424640:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305329.908878:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788305329.908889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788305329.908897:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761424768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305329.908931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761424768:12345-0@lo:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00080000:3.0:1788305329.911475:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305329.911492:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305329.911495:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305329.911546:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761424768:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.911561:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761424640:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.911571:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761425152:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.911609:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761425024:0@lo:400:kworker.0 00000100:00100000:3.0:1788305329.911620:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761424896:0@lo:400:kworker.0 00000100:00100000:0.0:1788305329.915894:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761424512 00000100:00100000:0.0:1788305329.915910:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761424512 00000100:00100000:0.0:1788305329.916404:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788305329.916417:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761424512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305329.916508:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761424512:12345-0@lo:400:kworker.0 Request processed in 93us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305329.916515:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788305329.916894:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761424512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305329.919917:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00010000:2.0:1788305330.033454:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305330.422400:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788305330.422440:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc131a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761425408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305330.422519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305330.422588:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761425280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305330.422612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305330.422645:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425408 00000100:00100000:3.0:1788305330.422652:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425408 00000100:00100000:3.0:1788305330.422691:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425280 00000100:00100000:3.0:1788305330.422693:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425280 00000100:00100000:3.0:1788305330.422706:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305330.422712:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761425408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305330.422762:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305330.422800:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761425408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305330.422805:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305330.422819:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305330.422823:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761425280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305330.422845:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305330.422865:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761425280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305330.422869:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305330.422900:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc131a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761425408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305330.422908:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761425280:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788305330.436828:0:12353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:28:48 (1788305328) 00010000:00010000:1.0:1788305331.058004:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305332.081222:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305332.285449:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305332.285779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741493248 00000100:00100000:3.0:1788305332.285791:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741493248 00000100:00100000:3.0:1788305332.285877:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:3.0:1788305332.285890:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+13:11303:x1875173741493248:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305332.285910:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305332.285961:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8de1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a60c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.286520:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.286537:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.286549:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.286647:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.286656:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.286691:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788305332.287596:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788305332.291406:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8df6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.291429:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8df6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.291442:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8df6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305332.291455:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788305332.292757:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292773:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292781:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292787:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305332.292791:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292797:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292812:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96fb88992200) 00010000:00010000:3.0:1788305332.292816:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305332.292829:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292846:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8de8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292862:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292868:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292874:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292879:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305332.292883:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292890:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292900:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96fb87f88500) 00010000:00010000:3.0:1788305332.292903:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305332.292908:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.292915:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8def lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.298673:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8de1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a60c expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.298716:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8df6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a60c expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305332.298726:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305332.298729:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305332.298732:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbce00, rc 0) 00000100:00100000:3.0:1788305332.298811:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+15:11303:x1875173741493248:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 12923us (13371us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788305332.298819:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:3.0:1788305332.304012:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305332.304156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305332.304629:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741493504 00000100:00100000:0.0:1788305332.304646:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741493504 00000100:00100000:0.0:1788305332.304737:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:0.0:1788305332.304755:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+15:11303:x1875173741493504:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788305332.304970:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+15:11303:x1875173741493504:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 219us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305332.304984:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:1.0:1788305332.305460:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741493376 00000100:00100000:1.0:1788305332.305470:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741493376 00000100:00100000:1.0:1788305332.305532:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1788305332.305540:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+15:2348:x1875173741493376:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305332.305552:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305332.305590:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8df6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a60c expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305332.305611:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:1.0:1788305332.305616:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305332.305643:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+14:2348:x1875173741493376:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 104us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305332.305650:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000040:00080000:1.0:1788305333.051989:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305333.051998:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305333.052046:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788305333.052070:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788305333.059594:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00010000:00010000:0.0:1788305333.105443:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305334.130770:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305334.797706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305334.797948:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741493632 00000100:00100000:3.0:1788305334.797959:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741493632 00000100:00080000:1.0:1788305334.798180:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305334.798642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:3.0:1788305334.798659:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:11346:x1875173741493632:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305334.798684:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305334.798711:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8e04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a613 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.798785:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.798800:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.798833:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.798848:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.798856:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.798863:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800733:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800750:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800758:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800764:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305334.800769:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800775:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800792:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:3.0:1788305334.800795:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305334.800800:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800813:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800827:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.800833:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801529:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801537:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305334.801541:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801548:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801559:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96fb87f88000) 00010000:00010000:3.0:1788305334.801562:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305334.801565:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801571:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801621:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8e04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a613 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801646:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:3.0:1788305334.801648:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305334.801652:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8e04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a613 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305334.801662:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc200, rc 0) 00000100:00100000:3.0:1788305334.801792:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+13:11346:x1875173741493632:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3138us (4096us total) trans 0 rc 301/301 00000100:00100000:3.0:1788305334.801802:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:2.0:1788305334.812357:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305334.816640:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741493888 00000100:00100000:1.0:1788305334.816657:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741493888 00000100:00100000:1.0:1788305334.817368:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:1.0:1788305334.817383:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+13:11346:x1875173741493888:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:1.0:1788305334.817458:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305334.817496:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc21fda00/0x902a3611c9ae8782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a44c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305334.817520:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:1.0:1788305334.817525:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305334.817771:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305334.817785:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 5 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305334.817793:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305334.817822:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 5 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305334.817837:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 5 pid: 8201 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305334.817851:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761425536:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305334.818715:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305334.831729:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761425536:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305334.831760:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305334.832031:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305334.832656:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494016 00000100:00100000:2.0:1788305334.832664:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494016 00010000:00010000:2.0:1788305334.832712:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 6 pid: 8201 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305334.832747:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1788305334.832754:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2347:x1875173741494016:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305334.832767:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305334.832772:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 6 pid: 8201 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.832781:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 6 pid: 8201 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.832797:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8dda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a605 expref: 6 pid: 8201 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.832809:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:2.0:1788305334.832814:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.832820:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.832825:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.832853:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305334.832905:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741494016:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 150us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305334.832912:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00080000:1.0:1788305334.833004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305334.833826:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305334.833851:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305334.833879:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305334.833891:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305334.833916:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305334.850705:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788305334.850738:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.850750:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.850758:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.850764:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305334.850769:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.850776:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.850794:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21afd00) 00010000:00010000:2.0:1788305334.850797:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305334.850801:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.850807:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae8e19 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305334.850825:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0a16a56 reply state 000000001e36bb06 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305334.850835:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305334.850944:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+14:11346:x1875173741493888:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 33561us (38595us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788305334.850953:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 140 00010000:00010000:2.0:1788305334.875003:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.875040:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.875049:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.875075:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bec00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305334.875090:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.875602:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.875627:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96fba21afc00) 00010000:00010000:2.0:1788305334.875631:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305334.875635:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305334.875642:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e20 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305334.929941:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305334.929982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305334.930090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305334.930148:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494400 00000100:00100000:3.0:1788305334.930159:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494400 00000100:00100000:3.0:1788305334.930221:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494272 00000100:00100000:3.0:1788305334.930225:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494272 00000100:00100000:3.0:1788305334.930249:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:3.0:1788305334.930260:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741494400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305334.930336:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741494400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305334.930344:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:3.0:1788305334.930361:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:3.0:1788305334.930368:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741494272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305334.930397:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741494272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305334.930651:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:1.0:1788305334.935653:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494144 00000100:00100000:1.0:1788305334.935671:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494144 00000100:00100000:1.0:1788305334.935738:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 295 00000100:00100000:1.0:1788305334.935749:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741494144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305334.935841:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741494144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 94us (5922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305334.935850:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 295 00000100:00080000:1.0:1788305334.935884:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305334.935889:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305335.002144:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305335.002636:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494528 00000100:00100000:0.0:1788305335.002646:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494528 00000100:00100000:0.0:1788305335.002711:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:0.0:1788305335.002722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+13:11354:x1875173741494528:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:0.0:1788305335.002753:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305335.002777:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a61a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.002843:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.002856:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.002868:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305335.002936:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788305335.002941:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305335.002968:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.003006:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a61a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.003025:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a61a expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.003047:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:0.0:1788305335.003049:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305335.003099:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bec00, rc 0) 00000100:00100000:0.0:1788305335.003183:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+14:11354:x1875173741494528:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 462us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305335.003190:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:1.0:1788305335.025528:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761425920:0@lo:400:kworker.0 00000100:00100000:1.0:1788305335.025614:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305335.025687:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305335.025695:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761426048:0@lo:400:kworker.0 00000100:00100000:1.0:1788305335.025721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305335.025760:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761426048 00000100:00100000:1.0:1788305335.025767:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761426048 00000100:00100000:1.0:1788305335.025820:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788305335.025829:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761426048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305335.025880:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761426048:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305335.025886:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788305335.025906:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305335.025936:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761426048:0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761425792:0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305335.026389:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761426304:0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305335.026447:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788305335.026454:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761425664:0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305335.026638:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761426176:0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305335.026694:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761426304 00000100:00100000:2.0:1788305335.026699:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761426304 00000100:00100000:2.0:1788305335.026777:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788305335.026784:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761426304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026821:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761426304:12345-0@lo:400:kworker.0 Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.026827:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788305335.026844:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425664 00000100:00100000:2.0:1788305335.026847:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425664 00000100:00100000:2.0:1788305335.026870:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788305335.026876:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761425664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.026903:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761425664:12345-0@lo:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.026909:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1788305335.026937:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305335.026948:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425920 00000100:00100000:2.0:1788305335.026953:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425920 00000100:00100000:2.0:1788305335.026981:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761425792 00000100:00100000:2.0:1788305335.026995:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761425792 00000100:00100000:2.0:1788305335.027008:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761426176 00000100:00100000:2.0:1788305335.027010:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761426176 00000100:00100000:2.0:1788305335.027024:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788305335.027030:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761425920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.027104:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761425920:12345-0@lo:400:kworker.0 Request processed in 74us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.027110:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788305335.027131:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788305335.027150:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761425792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.027182:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761425792:12345-0@lo:400:kworker.0 Request processed in 45us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.027187:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788305335.027198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788305335.027559:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761426176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305335.027590:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761426176:12345-0@lo:400:kworker.0 Request processed in 34us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305335.027761:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761425920:0@lo:400:kworker.0 00000100:00100000:0.0:1788305335.027796:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761425664:0@lo:400:kworker.0 00000100:00100000:0.0:1788305335.027806:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761426176:0@lo:400:kworker.0 00000100:00100000:0.0:1788305335.027816:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761425792:0@lo:400:kworker.0 00000100:00100000:0.0:1788305335.027825:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761426304:0@lo:400:kworker.0 00000100:00080000:0.0:1788305335.027857:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305335.039932:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788305335.103216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305335.103323:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494656 00000100:00100000:0.0:1788305335.103335:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494656 00000100:00100000:0.0:1788305335.103412:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:0.0:1788305335.103422:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+14:11360:x1875173741494656:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305335.103450:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305335.103472:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a621 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103559:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103594:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103606:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103623:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103630:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103798:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae8e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103806:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae8e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103814:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae8e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305335.103848:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788305335.103852:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305335.103877:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae8e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103889:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103907:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103914:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103921:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305335.103926:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103933:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103947:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:0.0:1788305335.103950:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305335.103955:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103960:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae8e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103976:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103993:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.103999:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104005:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bfa00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305335.104015:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104021:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104030:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96fba21af300) 00010000:00010000:0.0:1788305335.104033:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305335.104035:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104041:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae8e43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104146:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae8e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a621 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104164:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae8e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a621 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.104172:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305335.104175:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788305335.104178:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be000, rc 0) 00000100:00100000:0.0:1788305335.104242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+15:11360:x1875173741494656:12345-192.168.201.38@tcp:101:bash.0 Request processed in 820us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305335.104249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:2.0:1788305335.111455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.111623:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741494912 00000100:00100000:3.0:1788305335.111652:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741494912 00000100:00100000:3.0:1788305335.111748:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:3.0:1788305335.111763:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+15:11360:x1875173741494912:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305335.111794:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305335.111956:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8e51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a628 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.112220:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.112240:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.112254:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.112273:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.112281:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.112289:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305335.116396:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788305335.118716:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118780:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118843:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118901:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118910:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118918:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118925:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.118930:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118939:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118955:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305335.118959:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305335.118966:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.118973:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8e58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305335.118999:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e3bb3f9 reply state 00000000c1dae327 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.119019:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788305335.119131:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8e51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.119150:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.119159:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:3.0:1788305335.119161:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305335.119164:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbda00, rc 0) 00000100:00100000:3.0:1788305335.121245:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11360:x1875173741494912:12345-192.168.201.38@tcp:101:bash.0 Request processed in 9468us (9802us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788305335.121262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:2.0:1788305335.135259:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.135403:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741495040 00000100:00100000:3.0:1788305335.135417:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741495040 00000100:00100000:3.0:1788305335.135503:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788305335.135518:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741495040:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305335.135542:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305335.135571:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a62f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305335.135607:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788305335.135649:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1788305335.135655:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305335.135668:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.135723:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.135742:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc200, rc 0) 00000100:00100000:3.0:1788305335.135971:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741495040:12345-192.168.201.38@tcp:101:bash.0 Request processed in 456us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305335.135991:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00010000:00010000:1.0:1788305335.136653:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.136668:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.136676:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.136695:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305335.136700:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.136710:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.136728:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88000) 00010000:00010000:1.0:1788305335.136732:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305335.136737:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.136744:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8e5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305335.148488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.148705:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741495168 00000100:00100000:2.0:1788305335.148722:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741495168 00000100:00100000:2.0:1788305335.148793:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:2.0:1788305335.148812:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:11360:x1875173741495168:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788305335.148843:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305335.148869:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a636 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.148911:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.148922:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305335.148927:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305335.148934:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.149011:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.149028:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 7 pid: 6675 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305335.149045:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875173761426432:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305335.149872:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788305335.159114:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305335.163160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305335.163317:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741495296 00000100:00100000:1.0:1788305335.163330:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741495296 00010000:00010000:1.0:1788305335.163388:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 8 pid: 6675 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305335.163446:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1788305335.163459:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741495296:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305335.163480:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305335.163513:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 8 pid: 6675 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.163555:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 8 pid: 6675 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.163587:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305335.163593:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305335.163604:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.163615:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.163669:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305335.163690:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875173761426560:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788305335.163811:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788305335.164677:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f843694/0x902a3611c9ae8e74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a62f expref: 8 pid: 6675 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305335.164701:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875173761426432:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305335.164732:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.164748:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045800, rc 0) 00000100:00100000:2.0:1788305335.164819:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:11360:x1875173741495168:12345-192.168.201.38@tcp:101:bash.0 Request processed in 16008us (16346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.164828:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788305335.171001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.171345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741495552 00000100:00100000:2.0:1788305335.171362:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741495552 00000100:00100000:2.0:1788305335.171464:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1788305335.171478:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11360:x1875173741495552:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:1.0:1788305335.172529:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875173761426560:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788305335.172561:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305335.172610:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11360:x1875173741495552:12345-192.168.201.38@tcp:35:bash.0 Request processed in 1133us (1636us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788305335.172621:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:1.0:1788305335.175372:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741495296:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 11895us (12210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305335.175391:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1788305335.365729:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305335.365959:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741495808 00000100:00100000:1.0:1788305335.366042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741495808 00000100:00100000:1.0:1788305335.366305:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:1.0:1788305335.366325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11370:x1875173741495808:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305335.366351:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305335.366373:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a63d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305335.366500:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788305335.366630:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8e82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a63d expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.366646:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:1.0:1788305335.366650:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305335.366655:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae8e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a63d expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.366669:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f200, rc 0) 00000100:00100000:1.0:1788305335.366972:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11370:x1875173741495808:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 648us (1252us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1788305335.366989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:2.0:1788305335.371188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.371570:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741496064 00000100:00100000:3.0:1788305335.371586:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741496064 00000100:00100000:3.0:1788305335.371663:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:3.0:1788305335.371675:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11370:x1875173741496064:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305335.371960:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11370:x1875173741496064:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 287us (789us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788305335.371966:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:0.0:1788305335.465720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.465807:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741496192 00000100:00100000:3.0:1788305335.465816:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741496192 00000100:00100000:3.0:1788305335.466048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:2.0:1788305335.466466:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11376:x1875173741496192:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305335.466555:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305335.466577:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a644 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.466642:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.466656:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.466669:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305335.466728:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788305335.466731:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305335.466752:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.466777:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a644 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.466797:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a644 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.466825:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305335.466829:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305335.466832:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044400, rc 0) 00000100:00100000:2.0:1788305335.466937:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11376:x1875173741496192:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 846us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.466945:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:0.0:1788305335.476043:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.476234:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741496448 00000100:00100000:2.0:1788305335.476249:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741496448 00000100:00100000:2.0:1788305335.476329:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:2.0:1788305335.476342:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11376:x1875173741496448:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305335.476481:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305335.476509:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8e9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a64b expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.476638:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.476654:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.476665:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305335.476677:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788305335.476843:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8e9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a64b expref: 24 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.476888:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a64b expref: 23 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.476899:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:2.0:1788305335.476902:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305335.476907:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044e00, rc 0) 00000100:00100000:2.0:1788305335.480241:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11376:x1875173741496448:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3880us (4192us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788305335.480258:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:1.0:1788305335.486639:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305335.486696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305335.486799:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741496704 00000100:00100000:0.0:1788305335.486810:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741496704 00000100:00100000:3.0:1788305335.486813:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741496832 00000100:00100000:3.0:1788305335.486817:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741496832 00000100:00100000:3.0:1788305335.486880:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1788305335.486880:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:3.0:1788305335.486891:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+24:2347:x1875173741496832:12345-192.168.201.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788305335.486891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11376:x1875173741496704:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305335.486905:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305335.486911:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305335.486928:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae8ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a64b expref: 24 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.486928:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf600/0x902a3611c9ae8eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.486968:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:3.0:1788305335.486973:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305335.487050:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+24:2347:x1875173741496832:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 161us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1788305335.487207:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8eba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.487223:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.487235:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305335.487259:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788305335.487428:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf600/0x902a3611c9ae8eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a652 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.487444:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a652 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.487452:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:1.0:1788305335.487455:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788305335.487458:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f600, rc 0) 00000100:00100000:1.0:1788305335.487631:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11376:x1875173741496704:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 741us (1007us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788305335.487638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:3.0:1788305335.487857:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1788305335.498731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.498820:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741496960 00000100:00100000:3.0:1788305335.498830:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741496960 00000100:00100000:3.0:1788305335.498891:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788305335.498902:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741496960:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:3.0:1788305335.498955:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.498989:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.498998:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788305335.499002:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305335.499007:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.499045:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.499094:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 6 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.499132:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875173761426688:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305335.501437:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305335.503783:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875173761426688:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305335.503813:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305335.505717:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.507122:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741497088 00000100:00100000:3.0:1788305335.507139:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741497088 00002000:00100000:3.0:1788305335.507229:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff96fb985b1880 x1875173741497088/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:266/0 lens 504/0 e 0 to 0 dl 1788305346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305335.507243:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fb985b1880 with x1875173741497088 ext(0->12) 00010000:00010000:3.0:1788305335.507259:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 7 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.507281:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 7 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305335.507288:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96fb985b1880 00000100:00100000:3.0:1788305335.507335:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788305335.507347:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2348:x1875173741497088:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:3.0:1788305335.509043:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2348:x1875173741497088:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 1689us (3324us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788305335.509085:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00002000:00100000:3.0:1788305335.509108:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff96fb985b1880 x1875173741497088/t4294967305(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:266/0 lens 504/448 e 0 to 0 dl 1788305346 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305335.509119:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fb985b1880 with x1875173741497088 ext(0->12) 00010000:00010000:3.0:1788305335.509129:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 9 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.509148:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 9 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305335.509155:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96fb985b1880 00000100:00100000:2.0:1788305335.513513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305335.513691:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741497216 00000100:00100000:0.0:1788305335.513702:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741497216 00010000:00010000:0.0:1788305335.513750:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 9 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305335.513807:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1788305335.513818:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2350:x1875173741497216:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305335.513908:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788305335.513930:0:8499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788305335.513934:0:8499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788305334 00002000:00010000:0.0:1788305335.513936:0:8499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788305335 00002000:00010000:0.0:1788305335.513938:0:8499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788305334 00010000:00010000:0.0:1788305335.513944:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 9 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.513959:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 9 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.514022:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf602a75/0x902a3611c9ae8e7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a636 expref: 9 pid: 6678 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.514048:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305335.514212:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305335.514220:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.514231:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.514266:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305335.514328:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2350:x1875173741497216:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 511us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305335.514335:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00010000:00010000:3.0:1788305335.515100:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515113:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515148:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515157:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515165:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515172:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305335.515201:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515212:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515230:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.515238:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c8af61f/0x902a3611c9ae8ec8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.515340:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741496960:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 16437us (16616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305335.515349:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:0.0:1788305335.519816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.519896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741497472 00000100:00100000:3.0:1788305335.519906:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741497472 00000100:00100000:3.0:1788305335.519956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:3.0:1788305335.519968:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11376:x1875173741497472:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:3.0:1788305335.520047:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a652 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305335.520332:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788305335.520391:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788305335.521015:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1788305335.521098:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.521128:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.521137:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.521173:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.521188:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 28 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.521202:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875173761426816:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305335.521294:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305335.525680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.525879:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741497600 00000100:00100000:2.0:1788305335.525890:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741497600 00010000:00010000:2.0:1788305335.525933:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 29 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305335.525986:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1788305335.525996:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83073c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+29:2348:x1875173741497600:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305335.526011:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305335.526018:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 29 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.526032:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 29 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.526079:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:2.0:1788305335.526111:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.526120:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.526128:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.526146:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305335.526213:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83073c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+29:2348:x1875173741497600:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 217us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.526221:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00010000:00010000:3.0:1788305335.527972:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a628 expref: 28 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.528009:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875173761426816:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305335.528038:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.528048:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.528376:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305335.528510:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1788305335.528714:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788305335.528848:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761426944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788305335.528954:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305335.529032:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305335.529581:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761426944 00000100:00100000:0.0:1788305335.529589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761426944 00000100:00100000:0.0:1788305335.529682:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305335.529693:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875173761426944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788305335.529785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875173761426944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305335.529792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305335.529859:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761426944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788305335.530421:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788305335.530498:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761427072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788305335.530539:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305335.530997:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305335.531033:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761427072 00000100:00100000:1.0:1788305335.531039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761427072 00000100:00100000:1.0:1788305335.531133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305335.531143:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875173761427072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788305335.531492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875173761427072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 349us (952us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788305335.531500:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305335.531569:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875173761427072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788305335.531627:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788305335.531668:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.531679:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.531688:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.531694:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.531698:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.531705:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.531724:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:3.0:1788305335.531727:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788305335.531743:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.531750:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8ecf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305335.532022:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788305335.532399:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788305335.532412:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353242357755ns, next at 354242355079ns, rc = 0 00000001:00080000:3.0:1788305335.532419:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788305335.532454:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88500) 00010000:00010000:3.0:1788305335.532457:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788305335.532464:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8eba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a652 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.532562:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+31:11376:x1875173741497472:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 12597us (12757us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788305335.532571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000020:00080000:3.0:1788305335.532576:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788305335.536182:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.536386:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741497728 00000100:00100000:3.0:1788305335.536402:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741497728 00000100:00100000:3.0:1788305335.536476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:3.0:1788305335.536488:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+31:11376:x1875173741497728:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305335.536522:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305335.536558:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8ed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a659 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.536627:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a659 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.536674:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a659 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.536700:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305335.536704:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305335.536708:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbda00, rc 0) 00000100:00100000:3.0:1788305335.536792:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11376:x1875173741497728:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 306us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305335.536800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1788305335.539921:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305335.539944:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761427200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305335.540024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305335.540095:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761427200 00000100:00100000:2.0:1788305335.540102:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761427200 00000100:00100000:2.0:1788305335.540152:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305335.540161:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc139d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761427200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305335.540200:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305335.540253:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc139d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761427200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305335.540261:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305335.540495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761427200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305335.541413:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.541544:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741497984 00000100:00100000:2.0:1788305335.541551:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741497984 00000100:00100000:2.0:1788305335.541599:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788305335.541607:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11376:x1875173741497984:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305335.541875:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+33:11376:x1875173741497984:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 268us (465us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788305335.541883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788305335.553637:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761427328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305335.553717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305335.553796:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761427328 00000100:00100000:1.0:1788305335.553818:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761427328 00000100:00100000:1.0:1788305335.553889:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305335.553898:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761427328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305335.553936:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305335.568100:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761427328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14186us (14366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305335.568115:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788305335.580535:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761427328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305335.644938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.645047:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741498240 00000100:00100000:2.0:1788305335.645163:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741498240 00000100:00100000:1.0:1788305335.645603:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:1.0:1788305335.645616:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+33:11386:x1875173741498240:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305335.645640:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305335.645661:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a660 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305335.645773:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788305335.645879:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8edd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a660 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.645893:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:1.0:1788305335.645895:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305335.645900:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae8edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a660 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305335.645912:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305335.646097:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11386:x1875173741498240:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 483us (1165us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1788305335.646103:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:1.0:1788305335.653529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.653648:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741498368 00000100:00100000:3.0:1788305335.653659:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741498368 00000100:00100000:3.0:1788305335.653721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:3.0:1788305335.653732:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11386:x1875173741498368:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788305335.653811:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.653828:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.653854:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.653873:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.653881:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.653909:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654023:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654032:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654040:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305335.654121:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654134:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654140:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654147:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654153:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.654158:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654164:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654176:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305335.654185:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305335.654202:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654209:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654224:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654229:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654235:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654240:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.654243:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654249:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654257:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88500) 00010000:00010000:3.0:1788305335.654259:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305335.654262:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654267:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654280:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654292:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654298:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654303:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.654306:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654311:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654319:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305335.654322:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305335.654325:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.654330:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.654402:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11386:x1875173741498368:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 671us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305335.654411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:0.0:1788305335.658302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305335.658410:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741498624 00000100:00100000:2.0:1788305335.658420:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741498624 00000100:00100000:2.0:1788305335.658503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1788305335.658513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11386:x1875173741498624:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305335.658757:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+35:11386:x1875173741498624:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 244us (463us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788305335.658764:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:1.0:1788305335.694758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.694953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741498880 00000100:00100000:3.0:1788305335.694964:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741498880 00000100:00100000:3.0:1788305335.695183:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:3.0:1788305335.695255:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+35:11389:x1875173741498880:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305335.695285:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305335.695321:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a667 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695621:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695636:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695649:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695664:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695671:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695678:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695807:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.695816:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696007:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305335.696020:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788305335.696157:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696178:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696184:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696333:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.696338:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696345:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696503:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305335.696507:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305335.696513:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696520:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696537:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696543:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696549:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696554:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.696563:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696569:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696576:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88500) 00010000:00010000:3.0:1788305335.696579:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305335.696581:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696587:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696636:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696650:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.696657:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305335.696659:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305335.696661:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc400, rc 0) 00000100:00100000:3.0:1788305335.696797:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11389:x1875173741498880:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1545us (2049us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788305335.696805:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:1.0:1788305335.699756:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.699831:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741499008 00000100:00100000:3.0:1788305335.699839:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741499008 00000100:00100000:3.0:1788305335.699893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:3.0:1788305335.699903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11389:x1875173741499008:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1788305335.699995:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700016:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700027:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700195:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700205:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700212:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700218:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305335.700224:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700233:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700247:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305335.700250:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305335.700256:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305335.700261:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305335.700585:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11389:x1875173741499008:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 681us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305335.700594:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:0.0:1788305335.705226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.705481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741499264 00000100:00100000:3.0:1788305335.705490:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741499264 00000100:00100000:3.0:1788305335.705539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:3.0:1788305335.705547:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11389:x1875173741499264:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305335.705786:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+38:11389:x1875173741499264:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 238us (569us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788305335.705791:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:1.0:1788305335.976226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.980113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741499520 00000100:00100000:3.0:1788305335.980135:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741499520 00000100:00100000:2.0:1788305335.980526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:2.0:1788305335.980540:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+38:11420:x1875173741499520:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1788305335.980567:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305335.980590:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a66e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.980716:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.980733:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.980765:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305335.980780:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788305335.982327:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a66e expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.982370:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a66e expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305335.982381:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305335.982383:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305335.982387:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044800, rc 0) 00000100:00100000:2.0:1788305335.982474:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+40:11420:x1875173741499520:12345-192.168.201.38@tcp:101:cat.0 Request processed in 1936us (6257us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788305335.982483:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:1.0:1788305335.990012:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305335.990193:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305335.990701:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741499904 00000100:00100000:3.0:1788305335.990713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741499904 00000100:00100000:3.0:1788305335.990778:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788305335.990789:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+40:11420:x1875173741499904:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:3.0:1788305335.991178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+41:11420:x1875173741499904:12345-192.168.201.38@tcp:35:cat.0 Request processed in 389us (983us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788305335.991186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:0.0:1788305335.993027:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741499648 00000100:00100000:0.0:1788305335.993046:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741499648 00000100:00100000:0.0:1788305335.993593:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1788305335.993607:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+41:2349:x1875173741499648:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305335.993623:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305335.993650:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a66e expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305335.993673:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:0.0:1788305335.993679:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305335.993757:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+40:2349:x1875173741499648:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 153us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305335.993765:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788305336.065749:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305336.065911:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741500160 00000100:00100000:2.0:1788305336.065923:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741500160 00000100:00100000:2.0:1788305336.066022:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:2.0:1788305336.066034:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+40:11426:x1875173741500160:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:2.0:1788305336.066085:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788305336.066199:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788305336.066230:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305336.066266:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a644 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.066289:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305336.066312:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305336.066329:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a675 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.066451:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.066465:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.066474:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.066511:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.066526:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 40 pid: 5832 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305336.066539:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761427456:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305336.066651:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb93fb7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305336.070318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305336.070391:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761427456:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305336.070424:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305336.070563:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741500288 00000100:00100000:3.0:1788305336.070572:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741500288 00010000:00010000:3.0:1788305336.070613:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 41 pid: 5832 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305336.070654:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1788305336.070666:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+41:2348:x1875173741500288:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305336.070706:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305336.070714:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 41 pid: 5832 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.070728:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 41 pid: 5832 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.070758:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a667 expref: 41 pid: 5832 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.070776:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305336.070781:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.070789:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.070796:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.070824:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305336.070860:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.070868:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305336.070894:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788305336.071454:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 42 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.071475:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 41 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.071483:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305336.071486:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305336.071488:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044800, rc 0) 00000100:00100000:2.0:1788305336.071742:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+41:11426:x1875173741500160:12345-192.168.201.38@tcp:101:dd.0 Request processed in 5708us (6005us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788305336.071752:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:3.0:1788305336.072266:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+40:2348:x1875173741500288:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1598us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305336.072275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1788305336.075487:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305336.075566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741500544 00000100:00100000:2.0:1788305336.075577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741500544 00000100:00100000:2.0:1788305336.075636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 155 00000100:00100000:2.0:1788305336.075645:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+40:11426:x1875173741500544:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:2.0:1788305336.076043:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.076240:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.076257:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305336.076326:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1788305336.076374:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039ecc8e3 reply state 00000000734279ee transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305336.076384:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305336.076609:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+43:11426:x1875173741500544:12345-192.168.201.38@tcp:36:dd.0 Request processed in 962us (1130us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788305336.076617:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 155 00000020:00080000:2.0:1788305336.076625:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788305336.084752:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.084776:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.084785:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.084791:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305336.084796:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.084805:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.084825:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305336.084828:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305336.084834:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.084840:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305336.114515:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305336.114539:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305336.114747:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788305336.114756:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788305336.177338:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305336.517557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305336.517659:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741500672 00000100:00100000:3.0:1788305336.517672:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741500672 00000100:00100000:3.0:1788305336.517741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 156 00000100:00100000:3.0:1788305336.517751:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+42:11440:x1875173741500672:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:3.0:1788305336.517790:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305336.517826:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a67c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.517894:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.517908:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.517921:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.517934:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.517940:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.517947:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.518112:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.518124:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 43 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.518132:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.518168:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 43 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.518191:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 43 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305336.518205:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761427584:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305336.518505:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305336.521834:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761427584:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305336.521866:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305336.522661:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305336.522726:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741500928 00000100:00100000:2.0:1788305336.522735:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741500928 00000100:00100000:2.0:1788305336.523193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1788305336.523206:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+44:5587:x1875173741500928:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788305336.523667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+45:5587:x1875173741500928:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 463us (1008us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788305336.523673:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1788305336.526565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305336.526727:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741501056 00000100:00100000:1.0:1788305336.526738:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741501056 00010000:00010000:1.0:1788305336.526779:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 45 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305336.526897:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:0.0:1788305336.526907:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+45:2347:x1875173741501056:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305336.526919:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305336.526925:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 45 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.526935:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 45 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.526953:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae8f46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a675 expref: 45 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.527005:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:0.0:1788305336.527010:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.527019:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.527027:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527235:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527242:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305336.527286:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788305336.527290:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305336.527314:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527326:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527335:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527343:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527358:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527363:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305336.527366:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527371:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527385:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305336.527387:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305336.527390:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527394:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527401:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527405:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527409:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527411:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305336.527413:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527423:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527428:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88500) 00010000:00010000:3.0:1788305336.527429:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305336.527431:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527434:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8f69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527465:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a67c expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527478:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a67c expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.527485:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305336.527487:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305336.527489:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc600, rc 0) 00000100:00100000:3.0:1788305336.527546:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+44:11440:x1875173741500672:12345-192.168.201.38@tcp:101:stat.0 Request processed in 9796us (9999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305336.527555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 156 00010000:00010000:0.0:1788305336.527619:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305336.527642:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+43:2347:x1875173741501056:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 736us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305336.527648:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:0.0:1788305336.620250:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305336.620409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741501312 00000100:00100000:1.0:1788305336.620419:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741501312 00000100:00100000:1.0:1788305336.620486:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 157 00000100:00100000:1.0:1788305336.620499:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+43:11446:x1875173741501312:12345-192.168.201.38@tcp:36:truncate.0 00010000:00010000:1.0:1788305336.620563:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305336.620593:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae8f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a67c expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305336.620614:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:1.0:1788305336.620620:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305336.620842:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305336.620872:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305336.620881:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305336.620937:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1788305336.620974:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000555613bd reply state 00000000e43ec072 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305336.620984:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305336.622466:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+45:11446:x1875173741501312:12345-192.168.201.38@tcp:36:truncate.0 Request processed in 1962us (2217us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788305336.622477:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 157 00000020:00080000:1.0:1788305336.622485:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788305336.635132:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.635157:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.635168:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.635176:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305336.635182:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.635190:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.635247:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:0.0:1788305336.635251:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305336.635257:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305336.635265:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae8f77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305336.843427:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305336.843554:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741501440 00000100:00100000:2.0:1788305336.843565:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741501440 00000100:00100000:2.0:1788305336.843744:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:2.0:1788305336.843756:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+44:11460:x1875173741501440:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:2.0:1788305336.843781:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305336.843813:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a683 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.843889:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.843904:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.843914:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.843929:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.843966:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.843974:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844297:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844307:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844314:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305336.844352:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788305336.844356:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305336.844379:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844391:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844398:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844405:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844411:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844427:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305336.844432:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844439:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844452:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305336.844455:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305336.844460:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844465:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae8f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844481:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844488:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844493:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844498:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305336.844501:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844506:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844523:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb88992b00) 00010000:00010000:2.0:1788305336.844526:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305336.844529:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844534:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844569:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 46 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.844997:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 45 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305336.845007:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305336.845010:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305336.845012:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045400, rc 0) 00000100:00100000:2.0:1788305336.845490:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+45:11460:x1875173741501440:12345-192.168.201.38@tcp:101:stat.0 Request processed in 1734us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305336.845499:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:1.0:1788305336.955490:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305336.955681:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741501696 00000100:00100000:3.0:1788305336.955690:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741501696 00000100:00100000:3.0:1788305336.955783:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:3.0:1788305336.955792:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+45:11470:x1875173741501696:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305336.955834:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305336.955857:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a68a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305336.956014:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788305336.956199:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a68a expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.956215:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:3.0:1788305336.956218:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305336.956225:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a68a expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305336.956240:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc400, rc 0) 00000100:00100000:3.0:1788305336.956295:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+46:11470:x1875173741501696:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 503us (814us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1788305336.956302:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:1.0:1788305336.960305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305336.960382:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741501952 00000100:00100000:3.0:1788305336.960393:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741501952 00000100:00100000:3.0:1788305336.960493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788305336.960502:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+46:11470:x1875173741501952:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305336.960754:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+47:11470:x1875173741501952:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 253us (458us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788305336.960759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:0.0:1788305337.045760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.045894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741502208 00000100:00100000:3.0:1788305337.045905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741502208 00000100:00100000:3.0:1788305337.046047:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:3.0:1788305337.046116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+47:11476:x1875173741502208:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305337.046141:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305337.046164:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8fa8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a691 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.046269:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.046283:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 48 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.046292:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.046327:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 48 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.046340:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 48 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305337.046354:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc17b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761427712:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305337.046464:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305337.052023:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305337.052190:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741502336 00000100:00100000:0.0:1788305337.052204:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741502336 00010000:00010000:0.0:1788305337.052258:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 49 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305337.052298:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1788305337.052309:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+49:2348:x1875173741502336:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305337.052329:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305337.052337:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 49 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.052351:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 49 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.052378:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:0.0:1788305337.052384:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.052415:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.052422:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.052459:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305337.052518:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+49:2348:x1875173741502336:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 210us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305337.052526:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00010000:00010000:3.0:1788305337.053506:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae8f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a683 expref: 48 pid: 8201 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305337.053532:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc17b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761427712:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305337.053561:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.053735:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.053740:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305337.053762:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788305337.054848:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8fa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.054873:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.054882:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305337.054885:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305337.054888:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc200, rc 0) 00000100:00100000:3.0:1788305337.055923:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+48:11476:x1875173741502208:12345-192.168.201.38@tcp:101:bash.0 Request processed in 9797us (10161us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788305337.055934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:1.0:1788305337.062045:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.062351:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741502592 00000100:00100000:2.0:1788305337.062363:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741502592 00000100:00100000:2.0:1788305337.062528:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 161 00000100:00100000:2.0:1788305337.062541:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+48:11476:x1875173741502592:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:2.0:1788305337.063120:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.063141:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.063370:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305337.063437:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1788305337.063552:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ac773c9 reply state 00000000e1ca6fce transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305337.063564:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305337.068020:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+51:11476:x1875173741502592:12345-192.168.201.38@tcp:36:bash.0 Request processed in 5468us (5971us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788305337.068033:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 161 00000020:00080000:2.0:1788305337.068044:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788305337.075749:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.075765:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.075773:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.075779:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305337.075783:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.075790:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.075808:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305337.075811:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305337.075830:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.075836:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305337.109610:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305337.109656:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741502720 00000100:00100000:1.0:1788305337.109664:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741502720 00000100:00100000:1.0:1788305337.109709:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:1.0:1788305337.109716:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+50:11476:x1875173741502720:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305337.109736:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305337.109754:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a698 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.109844:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.109870:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.109877:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.109908:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.109922:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 51 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305337.109935:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761427840:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305337.110029:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305337.114034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.114155:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761427840:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305337.114181:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305337.115233:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741502848 00000100:00100000:1.0:1788305337.115242:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741502848 00010000:00010000:1.0:1788305337.115352:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 52 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305337.115390:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788305337.115401:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+52:2348:x1875173741502848:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305337.115415:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305337.115422:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 52 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.115516:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 52 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.115540:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae8faf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a691 expref: 52 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.115555:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:1.0:1788305337.115560:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.115569:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.115577:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.115653:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305337.115703:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+51:2348:x1875173741502848:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 304us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305337.115711:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00010000:00010000:0.0:1788305337.115842:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.115850:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305337.115981:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788305337.115986:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305337.116007:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.116037:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae8fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a698 expref: 51 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.116192:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a698 expref: 50 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.116202:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:0.0:1788305337.116211:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305337.116214:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f400, rc 0) 00000100:00100000:1.0:1788305337.116414:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+50:11476:x1875173741502720:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6695us (6815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305337.116422:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:1.0:1788305337.120965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.121264:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741503104 00000100:00100000:2.0:1788305337.121272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741503104 00000100:00100000:2.0:1788305337.121328:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1788305337.121339:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+50:11476:x1875173741503104:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1788305337.121608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+51:11476:x1875173741503104:12345-192.168.201.38@tcp:35:bash.0 Request processed in 269us (661us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788305337.121615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000001:00080000:0.0:1788305337.122377:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788305337.122388:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788305337.206655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.206737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741503360 00000100:00100000:3.0:1788305337.206750:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741503360 00000100:00100000:3.0:1788305337.206810:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:3.0:1788305337.206818:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+51:11486:x1875173741503360:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305337.206839:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305337.206860:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a69f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305337.207008:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788305337.207641:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305337.207960:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8fd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a69f expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.207978:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:0.0:1788305337.207981:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305337.207987:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae8fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a69f expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305337.208001:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc400, rc 0) 00000100:00100000:0.0:1788305337.208181:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11486:x1875173741503360:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1362us (1537us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1788305337.208189:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:1.0:1788305337.216829:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.216995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741503488 00000100:00100000:3.0:1788305337.217007:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741503488 00000100:00100000:3.0:1788305337.217375:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:3.0:1788305337.217388:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11486:x1875173741503488:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1788305337.217471:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217489:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217501:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217517:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217524:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217530:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217628:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217638:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217645:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305337.217702:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217715:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217721:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217734:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305337.217738:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217746:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217758:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305337.217761:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305337.217766:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217772:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae8fe0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217786:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217792:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217806:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217811:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305337.217813:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217819:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217828:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305337.217830:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305337.217833:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217838:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae8fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217852:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217858:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217864:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217869:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305337.217871:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217887:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217895:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305337.217897:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305337.217900:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.217905:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae8fee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305337.218000:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11486:x1875173741503488:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 615us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305337.218009:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:0.0:1788305337.221428:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.221550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741503744 00000100:00100000:2.0:1788305337.221562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741503744 00000100:00100000:2.0:1788305337.221653:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1788305337.221664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11486:x1875173741503744:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305337.221959:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+53:11486:x1875173741503744:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 296us (541us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788305337.221967:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:0.0:1788305337.272226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.272812:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741504000 00000100:00100000:2.0:1788305337.272823:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741504000 00000100:00100000:2.0:1788305337.272883:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:2.0:1788305337.272896:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+53:11489:x1875173741504000:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305337.272941:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305337.272974:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6a6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273108:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273124:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273135:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273150:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273157:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273415:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273541:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae900a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273550:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae900a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273557:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae900a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305337.273565:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788305337.273666:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273675:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273680:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273686:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305337.273690:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273697:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273709:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305337.273712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305337.273717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273723:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae8ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273737:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273742:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273747:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273752:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305337.273760:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273765:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273772:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb88992500) 00010000:00010000:2.0:1788305337.273775:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305337.273777:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273782:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273892:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae8ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6a6 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273909:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae900a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6a6 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.273916:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305337.273918:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305337.273921:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044e00, rc 0) 00000100:00100000:2.0:1788305337.274225:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11489:x1875173741504000:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1267us (1945us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788305337.274234:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:1.0:1788305337.285404:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.285581:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741504128 00000100:00100000:2.0:1788305337.285592:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741504128 00000100:00100000:2.0:1788305337.285655:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:2.0:1788305337.285667:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11489:x1875173741504128:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1788305337.285751:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285772:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285785:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285835:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285843:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285850:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285857:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305337.285862:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285871:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285886:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:2.0:1788305337.285889:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305337.285895:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.285901:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305337.286018:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11489:x1875173741504128:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 353us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305337.286027:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:0.0:1788305337.292390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.292480:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741504384 00000100:00100000:3.0:1788305337.292490:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741504384 00000100:00100000:3.0:1788305337.292550:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1788305337.292560:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11489:x1875173741504384:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305337.292814:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11489:x1875173741504384:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 253us (431us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788305337.292821:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1788305337.293839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.293916:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741504512 00000100:00100000:3.0:1788305337.293925:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741504512 00000100:00100000:3.0:1788305337.293988:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:3.0:1788305337.293997:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:2350:x1875173741504512:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305337.294011:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305337.294041:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae900a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6a6 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305337.294120:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:3.0:1788305337.294125:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305337.294663:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:2350:x1875173741504512:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 169us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305337.294672:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1788305337.500828:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305337.501125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741504768 00000100:00100000:1.0:1788305337.501136:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741504768 00000100:00100000:1.0:1788305337.501337:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:1.0:1788305337.501350:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11507:x1875173741504768:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:1.0:1788305337.501380:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305337.501408:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae901f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6ad expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.501512:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9026 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.501526:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9026 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.501536:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9026 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305337.501547:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788305337.501671:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae901f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ad expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.501690:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9026 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ad expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.501699:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:1.0:1788305337.501702:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788305337.501705:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fa00, rc 0) 00000100:00100000:1.0:1788305337.502011:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11507:x1875173741504768:12345-192.168.201.38@tcp:101:cat.0 Request processed in 663us (1193us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788305337.502036:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:1.0:1788305337.522866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.523562:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741504896 00000100:00100000:2.0:1788305337.523572:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741504896 00000100:00100000:2.0:1788305337.523626:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:2.0:1788305337.523637:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11508:x1875173741504896:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305337.523665:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305337.523685:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6b4 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.523753:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae903b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.523764:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae903b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.523771:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae903b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305337.523836:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788305337.523840:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305337.523862:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae903b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.523886:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6b4 expref: 59 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.523907:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae903b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6b4 expref: 58 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.523932:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305337.523935:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305337.523938:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044400, rc 0) 00000100:00100000:2.0:1788305337.524025:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+58:11508:x1875173741504896:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 389us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305337.524031:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:0.0:1788305337.529864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.529984:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741505280 00000100:00100000:3.0:1788305337.529995:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741505280 00000100:00100000:3.0:1788305337.530076:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1788305337.530280:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+58:11508:x1875173741505280:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305337.530703:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11508:x1875173741505280:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 615us (847us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788305337.530712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788305337.534420:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305337.534526:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741505408 00000100:00100000:1.0:1788305337.534537:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741505408 00000100:00100000:1.0:1788305337.534640:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305337.534651:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83073850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11508:x1875173741505408:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:1.0:1788305337.534667:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788305337.534691:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae8fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a698 expref: 59 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.534714:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ad expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.534727:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbda00/0x902a3611c9ae8ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a659 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.534738:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb87f88400) 00010000:00010000:1.0:1788305337.534748:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305337.534929:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83073850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11508:x1875173741505408:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 279us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305337.534938:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305337.544684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305337.544897:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741505536 00000100:00100000:2.0:1788305337.544915:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741505536 00000100:00100000:2.0:1788305337.545024:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:2.0:1788305337.545036:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11508:x1875173741505536:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:2.0:1788305337.545195:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.545213:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305337.545224:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305337.545436:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788305337.545544:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11508:x1875173741505536:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 509us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305337.545553:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:2.0:1788305337.567826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305337.567986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741505664 00000100:00100000:3.0:1788305337.568000:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741505664 00000100:00100000:1.0:1788305337.568271:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:1.0:1788305337.568288:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11510:x1875173741505664:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305337.568315:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305337.568361:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6bb expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568441:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568455:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568467:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568480:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568485:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568489:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568579:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568584:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568588:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305337.568620:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788305337.568623:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305337.568637:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568653:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568658:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568663:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568667:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568671:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305337.568674:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568679:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568689:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305337.568691:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305337.568694:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568697:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568707:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568711:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568718:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568721:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305337.568723:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568726:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568730:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fbb5e39e00) 00010000:00010000:1.0:1788305337.568731:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305337.568733:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568736:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568758:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 58 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568767:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 57 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305337.568771:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:1.0:1788305337.568772:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305337.568774:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ee00, rc 0) 00000100:00100000:0.0:1788305337.572554:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11510:x1875173741505664:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 4260us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305337.572568:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00000040:00080000:2.0:1788305338.164550:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305338.164559:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305338.164606:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788305338.164615:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788305338.164736:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761427968:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788305338.164861:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305338.184257:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761427968:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305338.207758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.212606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741505792 00000100:00100000:0.0:1788305338.212620:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741505792 00000100:00100000:0.0:1788305338.212699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:0.0:1788305338.212711:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11521:x1875173741505792:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788305338.212743:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788305338.213079:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11521:x1875173741505792:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 370us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.213088:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00080000:3.0:1788305338.218670:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305338.218868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.218899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741505920 00000100:00100000:3.0:1788305338.218909:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741505920 00000100:00100000:3.0:1788305338.218978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:3.0:1788305338.218990:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11521:x1875173741505920:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788305338.219108:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219126:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219160:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219178:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219186:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219193:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219222:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219230:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219236:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305338.219274:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788305338.219279:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305338.219294:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219304:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219309:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219325:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219331:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305338.219335:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219341:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219353:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305338.219356:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305338.219361:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219366:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9065 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219378:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219383:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219388:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219392:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305338.219394:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219414:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219422:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305338.219424:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305338.219427:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219432:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae906c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219445:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219450:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219454:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219458:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305338.219460:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219465:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219470:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:3.0:1788305338.219472:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305338.219475:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.219489:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae9073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305338.219559:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11521:x1875173741505920:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 571us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.219568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:0.0:1788305338.230013:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.230069:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741506176 00000100:00100000:0.0:1788305338.230078:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741506176 00000100:00100000:0.0:1788305338.230134:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:0.0:1788305338.230156:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11521:x1875173741506176:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305338.230180:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305338.230201:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf600/0x902a3611c9ae907a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6c2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230301:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230316:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230327:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305338.230339:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788305338.230537:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230560:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230567:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230573:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305338.230578:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230586:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230599:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:0.0:1788305338.230602:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305338.230606:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230612:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf000/0x902a3611c9ae9081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230663:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf600/0x902a3611c9ae907a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6c2 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230675:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:0.0:1788305338.230677:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305338.230681:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf600/0x902a3611c9ae907a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6c2 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.230690:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf600, rc 0) 00000100:00100000:0.0:1788305338.230777:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+58:11521:x1875173741506176:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 633us (774us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1788305338.230798:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 173 00010000:00010000:0.0:1788305338.235989:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788305338.241788:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1788305338.242460:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:3.0:1788305338.242485:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788305338.242512:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fb88a5ae40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788305338.242518:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb895dd100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fb88a5ad80 00000020:00080000:3.0:1788305338.242521:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb895dde00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fb93e84000 00000020:00080000:3.0:1788305338.242554:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788305338.242744:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788305338.245013:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761428096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788305338.245247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305338.245411:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.245659:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761428096 00000100:00100000:3.0:1788305338.245667:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761428096 00000100:00100000:3.0:1788305338.245741:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305338.245753:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761428096:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788305338.245921:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788305338.245986:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788305338.246023:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a975fb6, atime: 0x6a975fb7, ctime: 0x6a975fb6, blocks: 0xb 00010000:00010000:3.0:1788305338.246032:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.246048:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788305338.246544:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305338.246552:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.246581:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.246591:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.246599:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.246624:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305338.248000:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305338.248016:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.248030:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbde00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305338.248035:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.248047:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.249341:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.249352:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008714c56b/0x902a3611c9ae908f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.249373:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305338.249376:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305338.249379:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305338.250298:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741506304 00000100:00100000:0.0:1788305338.250312:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741506304 00000100:00100000:0.0:1788305338.250386:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:0.0:1788305338.250399:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741506304:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788305338.250447:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788305338.250571:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741506304:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 174us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.250579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:3.0:1788305338.256731:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761428096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10972us (11475us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788305338.256744:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305338.258641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.259454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741506560 00000100:00100000:1.0:1788305338.259475:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741506560 00000100:00100000:1.0:1788305338.259537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:1.0:1788305338.259549:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741506560:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305338.259570:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305338.259573:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788305338.259600:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae903b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6b4 expref: 17 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.259619:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305338.259625:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305338.259638:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9096 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6c9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305338.262674:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00000100:00100000:0.0:1788305338.262985:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788305338.262993:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788305338.263020:0:3301:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff96fb88f29f80 x1875173761428096/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305354 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788305338.263035:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fb88f29f80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788305338.263041:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761428096:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788305338.264379:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae909d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.264403:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae909d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.264427:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae909d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.264501:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae9096 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6c9 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.264519:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae909d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6c9 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.264527:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:2.0:1788305338.264530:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305338.264533:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044800, rc 0) 00000100:00100000:2.0:1788305338.264595:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11521:x1875173741506560:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 5047us (5963us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788305338.264604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:0.0:1788305338.269545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.269636:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741506816 00000100:00100000:1.0:1788305338.269649:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741506816 00000100:00100000:1.0:1788305338.269712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:1.0:1788305338.269723:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11521:x1875173741506816:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305338.269797:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305338.269825:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae909d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6c9 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.269983:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305338.269995:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305338.270018:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270030:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270080:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270097:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270104:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270111:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270399:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270407:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270412:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270418:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305338.270423:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270431:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270440:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305338.270443:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305338.270447:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270459:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270469:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270475:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270481:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270485:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305338.270489:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270494:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270502:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6a24800e (ffff96fbb5e39200) 00010000:00010000:1.0:1788305338.270504:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305338.270506:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.270512:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae90b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a24800e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305338.270595:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741506816:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 873us (1061us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305338.270603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:0.0:1788305338.275889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.276285:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741506944 00000100:00100000:3.0:1788305338.276300:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741506944 00000100:00100000:3.0:1788305338.276378:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:3.0:1788305338.276390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741506944:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305338.276410:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305338.276434:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6d0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.276476:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.276490:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.276526:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.276631:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.276649:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.276659:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305338.276662:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305338.276665:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd400, rc 0) 00000100:00100000:3.0:1788305338.276736:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11521:x1875173741506944:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 349us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.276744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:0.0:1788305338.283234:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.283274:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741507200 00000100:00100000:0.0:1788305338.283294:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741507200 00000100:00100000:0.0:1788305338.283352:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 178 00000100:00100000:0.0:1788305338.283362:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11521:x1875173741507200:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788305338.283444:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.283460:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.283471:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305338.283730:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788305338.283738:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355993684631ns, next at 356993682642ns, rc = 0 00000004:00010000:0.0:1788305338.283822:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba435d00 reply state 0000000027f36b16 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.283832:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305338.283936:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11521:x1875173741507200:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 565us (702us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788305338.283945:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 178 00010000:00010000:2.0:1788305338.289245:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.289257:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.289263:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.289268:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bfe00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305338.289271:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.289276:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.289298:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:2.0:1788305338.289300:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788305338.289303:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.289307:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae90c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.293041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.293530:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741507328 00000100:00100000:3.0:1788305338.293541:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741507328 00000100:00100000:3.0:1788305338.293599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:3.0:1788305338.293607:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11521:x1875173741507328:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305338.293629:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305338.293647:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.293699:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.293711:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.293741:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305338.293744:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305338.293748:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd000, rc 0) 00000100:00100000:3.0:1788305338.293822:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11521:x1875173741507328:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 215us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.293827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:1.0:1788305338.305496:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305338.305587:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741507456 00000100:00100000:2.0:1788305338.305596:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741507456 00000100:00100000:2.0:1788305338.305680:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:2.0:1788305338.305692:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2349:x1875173741507456:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788305338.306097:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741507456:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 406us (611us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788305338.306106:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00080000:3.0:1788305338.306526:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305338.309192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305338.309289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741507712 00000100:00100000:2.0:1788305338.309299:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741507712 00000100:00100000:2.0:1788305338.309350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:2.0:1788305338.309360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11521:x1875173741507712:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788305338.309599:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11521:x1875173741507712:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 239us (415us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788305338.309607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:2.0:1788305338.312698:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.312886:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741507968 00000100:00100000:0.0:1788305338.312896:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741507968 00000100:00100000:0.0:1788305338.313015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:0.0:1788305338.313027:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11521:x1875173741507968:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788305338.313190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11521:x1875173741507968:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 165us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.313198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:1.0:1788305338.316557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.316685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508096 00000100:00100000:3.0:1788305338.316696:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508096 00000100:00100000:3.0:1788305338.316801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:3.0:1788305338.316812:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11521:x1875173741508096:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305338.316834:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305338.316856:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae90d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6de expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.316922:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae90dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.316948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae90dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.316961:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae90dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305338.317001:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305338.317021:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae90dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.317099:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae90d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6de expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.317118:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae90dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6de expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.317127:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305338.317129:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305338.317133:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbdc00, rc 0) 00000100:00100000:3.0:1788305338.317327:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11521:x1875173741508096:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 516us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.317335:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:1.0:1788305338.321599:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305338.321718:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508224 00000100:00100000:2.0:1788305338.321731:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508224 00000100:00100000:2.0:1788305338.321891:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:2.0:1788305338.321918:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741508224:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305338.321948:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305338.321972:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6e5 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305338.322369:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a975fba, blocks: 0x1 00010000:00010000:2.0:1788305338.322400:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1788305338.322405:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305338.322416:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.322437:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.322453:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044400, rc 0) 00000100:00100000:2.0:1788305338.322540:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741508224:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 625us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305338.322548:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788305338.325320:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.325432:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508480 00000100:00100000:0.0:1788305338.325442:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508480 00000100:00100000:0.0:1788305338.325512:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:0.0:1788305338.325525:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11521:x1875173741508480:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788305338.325644:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11521:x1875173741508480:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 121us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.325652:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:0.0:1788305338.329523:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305338.329621:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508608 00000100:00100000:2.0:1788305338.329632:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508608 00000100:00100000:2.0:1788305338.329692:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:2.0:1788305338.329704:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:11521:x1875173741508608:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305338.329722:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305338.329742:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6ec expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.329802:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.329811:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305338.329815:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305338.329821:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 9 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.329854:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.329867:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 9 pid: 6678 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305338.329881:0:11977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761428224:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305338.329977:0:11977:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305338.338413:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.338513:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508736 00000100:00100000:1.0:1788305338.338526:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508736 00010000:00010000:1.0:1788305338.338576:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 10 pid: 6678 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305338.338617:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:1.0:1788305338.338628:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2348:x1875173741508736:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305338.338643:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305338.338668:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 10 pid: 6678 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.338683:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 10 pid: 6678 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.338712:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305338.338718:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305338.338726:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 10 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.338736:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 10 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.338793:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 10 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305338.338823:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875173761428352:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788305338.338906:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788305338.339131:0:11977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae90e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6e5 expref: 10 pid: 6678 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305338.339147:0:11977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761428224:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305338.339173:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 9 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.339183:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045400, rc 0) 00000100:00100000:2.0:1788305338.339225:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+9:11521:x1875173741508608:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 9523us (9712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305338.339233:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1788305338.348454:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.348550:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508864 00000100:00100000:0.0:1788305338.348561:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508864 00002000:00100000:0.0:1788305338.348615:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96fbc17b4000 x1875173741508864/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:269/0 lens 504/0 e 0 to 0 dl 1788305349 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305338.348627:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc17b4000 with x1875173741508864 ext(0->8) 00002000:00010000:0.0:1788305338.348633:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbc17b4000 00000100:00100000:0.0:1788305338.348667:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1788305338.348677:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2350:x1875173741508864:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788305338.349175:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+11:2350:x1875173741508864:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 498us (729us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788305338.349183:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00002000:00100000:0.0:1788305338.349190:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96fbc17b4000 x1875173741508864/t4294967314(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:269/0 lens 504/448 e 0 to 0 dl 1788305349 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305338.349198:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc17b4000 with x1875173741508864 ext(0->8) 00002000:00010000:0.0:1788305338.349202:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbc17b4000 00000100:00100000:1.0:1788305338.349925:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875173761428352:192.168.201.38@tcp:105: 00010000:00010000:1.0:1788305338.349956:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305338.352285:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2348:x1875173741508736:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 13647us (13871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.352300:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788305338.352382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.352483:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741508992 00000100:00100000:3.0:1788305338.352491:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741508992 00000100:00100000:3.0:1788305338.352538:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:3.0:1788305338.352546:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11521:x1875173741508992:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788305338.428373:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11521:x1875173741508992:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 71875us (72038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.428405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:0.0:1788305338.428667:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000001:00080000:3.0:1788305338.429242:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788305338.429250:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1788305338.429275:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:3.0:1788305338.429282:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788305338.429305:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741509120 00000100:00100000:3.0:1788305338.429314:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741509120 00000100:00100000:3.0:1788305338.429359:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:3.0:1788305338.429369:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2350:x1875173741509120:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000020:00080000:0.0:1788305338.432135:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788305338.432168:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788305338.433044:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761428480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305338.433154:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305338.433329:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761428480 00000100:00100000:3.0:1788305338.433337:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761428480 00000100:00100000:3.0:1788305338.433391:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788305338.433400:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761428480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788305338.434675:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788305338.434682:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788305338 00002000:00010000:3.0:1788305338.434686:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788305338.434688:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788305338 -> 1788305338 00002000:00010000:3.0:1788305338.434690:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788305338.446587:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761428480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 13009us (13266us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788305338.446605:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788305338.446659:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788305338.451338:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fb985b2300/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788305338.451358:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761428480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788305338.568368:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2350:x1875173741509120:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 138989us (139691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305338.568381:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000001:00080000:1.0:1788305338.568421:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1788305338.568439:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788305338.576276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.576340:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741509376 00000100:00100000:1.0:1788305338.576351:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741509376 00000100:00100000:1.0:1788305338.576413:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 184 00000100:00100000:1.0:1788305338.576425:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11521:x1875173741509376:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305338.576483:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305338.576513:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbdc00/0x902a3611c9ae90dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6de expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.576537:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:1.0:1788305338.576544:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305338.576584:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.576613:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.576624:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305338.578232:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075db7c06 reply state 0000000034eb7e64 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305338.578251:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305338.578405:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11521:x1875173741509376:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1976us (2134us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788305338.578415:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 184 00010000:00010000:2.0:1788305338.584472:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.584491:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.584499:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.584505:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305338.584511:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.584520:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.584542:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:2.0:1788305338.584546:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305338.584551:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.584558:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae90f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305338.589665:0:12507:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305338.589676:0:12507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305338.589722:0:12507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000100:00100000:2.0:1788305338.590679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.591707:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741509504 00000100:00100000:3.0:1788305338.591719:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741509504 00000100:00100000:3.0:1788305338.591984:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:3.0:1788305338.591997:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741509504:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788305338.592308:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788305338.592315:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788305338 -> 1788305336 00002000:00010000:3.0:1788305338.592318:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788305335 00002000:00010000:3.0:1788305338.592320:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788305338 -> 1788305336 00002000:00010000:3.0:1788305338.592322:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788305338.592391:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2349:x1875173741509504:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 397us (1719us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788305338.592400:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000040:00080000:1.0:1788305338.592658:0:12507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305338.602125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305338.602352:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741509760 00000100:00100000:3.0:1788305338.602364:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741509760 00000100:00100000:3.0:1788305338.602427:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:3.0:1788305338.602439:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11521:x1875173741509760:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788305338.602515:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.602535:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.602546:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.602586:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.602600:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 18 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305338.602629:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f73100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761428608:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305338.602756:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305338.612317:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f73100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761428608:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305338.612352:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305338.614554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.614822:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741509888 00000100:00100000:0.0:1788305338.614834:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741509888 00010000:00010000:0.0:1788305338.614882:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.614939:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1788305338.614950:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2348:x1875173741509888:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305338.614967:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305338.614976:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.614990:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.615016:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd400/0x902a3611c9ae90c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d0 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.615034:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:0.0:1788305338.615039:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.615049:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.615098:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.615136:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305338.615198:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+18:2348:x1875173741509888:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 248us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.615207:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00010000:00010000:3.0:1788305338.616841:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616857:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616896:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616903:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616912:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616919:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305338.616931:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616939:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616977:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305338.616980:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788305338.616985:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.616991:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae90f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305338.617113:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741509760:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 14673us (14994us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788305338.617123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:3.0:1788305338.621259:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305338.621338:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741510016 00000100:00100000:2.0:1788305338.621349:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741510016 00000100:00100000:2.0:1788305338.621409:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1788305338.621420:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2350:x1875173741510016:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788305338.621482:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.621506:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.621516:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305338.621522:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305338.621527:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.621566:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.621582:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 8 pid: 11977 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305338.621596:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875173761428736:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305338.621748:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305338.652727:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.652812:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741510144 00000100:00100000:1.0:1788305338.652823:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741510144 00010000:00010000:1.0:1788305338.652871:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 9 pid: 11977 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305338.652918:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:1.0:1788305338.652938:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741510144:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305338.652954:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305338.652984:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 9 pid: 11977 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.653026:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 9 pid: 11977 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.653088:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305338.653096:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305338.653103:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.653115:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.653154:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305338.653218:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741510144:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 282us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305338.653226:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00010000:00010000:3.0:1788305338.654500:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050863be/0x902a3611c9ae90ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6ec expref: 8 pid: 11977 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305338.654526:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875173761428736:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305338.654553:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654564:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654571:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654627:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654636:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654644:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654652:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044e00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305338.654659:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654669:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654688:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.654695:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000769a7ee/0x902a3611c9ae90ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305338.654784:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741510016:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 33366us (33536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305338.654793:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1788305338.680868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.681002:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741510400 00000100:00100000:0.0:1788305338.681012:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741510400 00000100:00100000:0.0:1788305338.681115:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 186 00000100:00100000:0.0:1788305338.681126:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+17:11521:x1875173741510400:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788305338.681213:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681231:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681243:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681431:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681442:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681451:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681483:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.681510:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 18 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.681525:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761428864:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305338.681618:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb895e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305338.685399:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761428864:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305338.685432:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305338.685962:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305338.686405:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741510528 00000100:00100000:0.0:1788305338.686414:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741510528 00010000:00010000:0.0:1788305338.686454:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.686494:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:0.0:1788305338.686505:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2348:x1875173741510528:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305338.686521:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305338.686529:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.686542:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.686564:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd000/0x902a3611c9ae90ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6d7 expref: 19 pid: 5833 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.686598:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:0.0:1788305338.686604:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.686612:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.686620:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.686656:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305338.686709:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+18:2348:x1875173741510528:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 205us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.686717:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00010000:00010000:3.0:1788305338.687083:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305338.687108:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305338.687321:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788305338.687468:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788305338.687514:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788305338.687595:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761428992:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788305338.687646:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305338.687677:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305338.689611:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761428992 00000100:00100000:0.0:1788305338.689624:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761428992 00000100:00100000:0.0:1788305338.689699:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305338.689710:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8201:x1875173761428992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788305338.689835:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8201:x1875173761428992:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305338.689844:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305338.690023:0:8201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788305338.690029:0:8201:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fb985b2300, transno 4294967315 00000100:00100000:3.0:1788305338.690049:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761428992:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788305338.690681:0:8201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788305338.690759:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761429120:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788305338.690817:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305338.690845:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862cb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305338.691361:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761429120 00000100:00100000:2.0:1788305338.691370:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761429120 00000100:00100000:2.0:1788305338.691415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305338.691425:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8201:x1875173761429120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788305338.691664:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8201:x1875173761429120:12345-0@lo:1000:mdt00_003.0 Request processed in 240us (845us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788305338.691683:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305338.691731:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8201:1875173761429120:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788305338.691765:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691789:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691797:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691804:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305338.691808:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691816:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691832:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:2.0:1788305338.691835:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305338.691839:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691845:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae910d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691876:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691882:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691898:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691903:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305338.691906:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691913:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691929:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:2.0:1788305338.691931:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305338.691934:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691940:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9042 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691963:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691978:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 21 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.691987:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.692014:0:8201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 21 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305338.692037:0:8201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 21 pid: 8201 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305338.692050:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761429248:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305338.692134:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305338.699447:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8201:1875173761429248:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305338.699477:0:8201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.712496:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.712580:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741510656 00000100:00100000:1.0:1788305338.712591:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741510656 00010000:00010000:1.0:1788305338.712637:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 22 pid: 8201 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305338.712684:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:1.0:1788305338.712694:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+22:2347:x1875173741510656:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305338.712711:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305338.712718:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 22 pid: 8201 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.712748:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 22 pid: 8201 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.712770:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae905e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6bb expref: 22 pid: 8201 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.712800:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:1.0:1788305338.712805:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.712814:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.712821:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.712858:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305338.712917:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+21:2347:x1875173741510656:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 224us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305338.712935:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00010000:00010000:0.0:1788305338.712991:0:8201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.712999:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713022:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713028:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713035:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713041:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305338.713046:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713080:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713091:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:0.0:1788305338.713094:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305338.713098:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713104:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9114 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713116:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713123:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713128:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713147:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305338.713150:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713156:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713165:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992500) 00010000:00010000:0.0:1788305338.713168:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305338.713170:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.713176:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae9106 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305338.713392:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11521:x1875173741510400:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 32267us (32536us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788305338.713402:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 186 00000020:00080000:0.0:1788305338.713406:0:8201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788305338.713954:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305338.713960:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305338.714452:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788305338.714464:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305338.730186:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305338.730432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741510912 00000100:00100000:1.0:1788305338.730441:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741510912 00000100:00100000:1.0:1788305338.730487:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1788305338.730497:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02de450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11521:x1875173741510912:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788305338.731415:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788305338.731523:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1788305338.731581:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.731599:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.731612:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.731624:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.731631:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.731639:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305338.731663:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788305338.731798:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02de450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11521:x1875173741510912:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1299us (1620us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788305338.731808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000020:00080000:1.0:1788305338.731815:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788305338.732216:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305338.732226:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.732234:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ee00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305338.732240:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.732250:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.732281:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96fbb5e39900) 00010000:00010000:0.0:1788305338.732284:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305338.732290:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.732296:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae911b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305338.732315:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305338.732317:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305338.732319:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305339.249659:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305340.044799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305340.044854:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305340.044886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305340.044917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305340.044944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305340.044977:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511424 00000100:00100000:3.0:1788305340.044987:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511424 00000100:00100000:3.0:1788305340.045040:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511296 00000100:00100000:3.0:1788305340.045044:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511296 00000100:00100000:3.0:1788305340.045117:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:3.0:1788305340.045128:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741511424:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305340.045225:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741511424:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 98us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305340.045233:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:3.0:1788305340.045251:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:3.0:1788305340.045258:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741511296:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305340.045742:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511168 00000100:00100000:1.0:1788305340.045749:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511168 00000100:00100000:1.0:1788305340.045789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511552 00000100:00100000:1.0:1788305340.045793:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511552 00000100:00100000:1.0:1788305340.045830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:1.0:1788305340.045839:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+22:2347:x1875173741511168:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305340.045886:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+22:2347:x1875173741511168:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 48us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305340.045894:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:1.0:1788305340.045921:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:1.0:1788305340.045928:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741511552:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305340.045952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741511552:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305340.045960:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:1.0:1788305340.045978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511040 00000100:00100000:1.0:1788305340.045982:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511040 00000100:00100000:1.0:1788305340.046007:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00100000:1.0:1788305340.046014:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741511040:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305340.046039:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741511040:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305340.046047:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00080000:1.0:1788305340.046128:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305340.046133:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305340.046135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305340.047796:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741511296:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305340.047828:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:1.0:1788305340.147432:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761429632:0@lo:400:kworker.0 00000100:00100000:0.0:1788305340.147432:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761429376:0@lo:400:kworker.0 00000100:00100000:2.0:1788305340.147627:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761429504:0@lo:400:kworker.0 00000100:00100000:1.0:1788305340.147716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305340.147789:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305340.147795:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761429760:0@lo:400:kworker.0 00000100:00100000:1.0:1788305340.147821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305340.147865:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761429760 00000100:00100000:1.0:1788305340.147872:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761429760 00000100:00100000:1.0:1788305340.147951:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788305340.147960:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761429760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305340.148026:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761429760:12345-0@lo:400:kworker.0 Request processed in 67us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305340.148033:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788305340.148083:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305340.148133:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761429760:0@lo:400:kworker.0 00000100:00100000:0.0:1788305340.148262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305340.148293:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761429888:0@lo:400:kworker.0 00000100:00100000:0.0:1788305340.148319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305340.148351:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761429632 00000100:00100000:0.0:1788305340.148355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761429632 00000100:00100000:0.0:1788305340.148393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761429888 00000100:00100000:0.0:1788305340.148397:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761429888 00000100:00100000:0.0:1788305340.148420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788305340.148426:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761429632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305340.148465:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761429632:12345-0@lo:400:kworker.0 Request processed in 39us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305340.148472:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788305340.148484:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305340.148490:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761429888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788305340.148515:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305340.148519:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875173761429888:12345-0@lo:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305340.148532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305340.148565:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761429888:0@lo:400:kworker.0 00000100:00100000:0.0:1788305340.148588:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761429632:0@lo:400:kworker.0 00000100:00100000:1.0:1788305340.148969:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761429376 00000100:00100000:1.0:1788305340.148974:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761429376 00000100:00100000:1.0:1788305340.149001:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788305340.149008:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761429376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305340.149083:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761429376:12345-0@lo:400:kworker.0 Request processed in 41us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305340.149091:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788305340.149178:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761429376:0@lo:400:kworker.0 00000100:00100000:2.0:1788305340.152034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305340.152406:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761430016:0@lo:400:kworker.0 00000100:00100000:2.0:1788305340.152446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305340.152532:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761429504 00000100:00100000:0.0:1788305340.152543:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761429504 00000100:00100000:3.0:1788305340.152617:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761430016 00000100:00100000:3.0:1788305340.152622:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761430016 00000100:00100000:0.0:1788305340.152628:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788305340.152638:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761429504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305340.152659:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788305340.152665:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761430016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305340.152697:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761430016:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305340.152697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761429504:12345-0@lo:400:kworker.0 Request processed in 60us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305340.152704:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305340.152704:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1788305340.152728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305340.152761:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761429504:0@lo:400:kworker.0 00000100:00100000:2.0:1788305340.152775:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761430016:0@lo:400:kworker.0 00010000:00010000:3.0:1788305340.278407:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305340.661026:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305340.661047:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba0598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761430144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305340.661156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305340.661471:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761430144 00000100:00100000:3.0:1788305340.661479:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761430144 00000100:00100000:3.0:1788305340.661534:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788305340.661544:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761430144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305340.661596:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305340.661643:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761430144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305340.661650:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788305340.661694:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba0598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761430144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305340.664159:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761430272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305340.664423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305340.664621:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761430272 00000100:00100000:0.0:1788305340.664629:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761430272 00000100:00100000:0.0:1788305340.664679:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788305340.664688:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761430272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305340.664723:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305340.664783:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761430272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305340.664790:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305340.665388:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761430272:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788305340.733477:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305340.733487:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305340.733524:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788305340.733532:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305341.009873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305341.013476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511808 00000100:00100000:2.0:1788305341.013490:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511808 00000100:00100000:2.0:1788305341.013562:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:2.0:1788305341.013573:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11540:x1875173741511808:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305341.013594:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305341.013616:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6f3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.013908:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae9129 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.013923:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae9129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.013936:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae9129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305341.013947:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788305341.014645:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6f3 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.014664:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae9129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6f3 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.014672:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305341.014675:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305341.014679:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044e00, rc 0) 00000100:00100000:2.0:1788305341.014788:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11540:x1875173741511808:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1216us (4925us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788305341.014797:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:2.0:1788305341.055170:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305341.055220:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741511936 00000100:00100000:2.0:1788305341.055230:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741511936 00000100:00100000:2.0:1788305341.055292:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:2.0:1788305341.055503:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11540:x1875173741511936:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:2.0:1788305341.055593:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.055612:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.055624:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.055639:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.055646:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.055652:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056074:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056084:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056092:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305341.056263:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056278:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056360:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056369:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056377:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.056381:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056389:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056401:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305341.056405:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.056410:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056416:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056430:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056436:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056442:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056447:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.056456:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056462:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056470:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb88992900) 00010000:00010000:2.0:1788305341.056472:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.056475:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056481:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae913e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056499:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056504:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056509:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056514:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.056517:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056522:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056529:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992f00) 00010000:00010000:2.0:1788305341.056531:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.056540:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.056546:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305341.056636:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11540:x1875173741511936:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1136us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305341.056644:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:3.0:1788305341.135463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.135573:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741512192 00000100:00100000:1.0:1788305341.135584:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741512192 00000100:00100000:1.0:1788305341.135661:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:1.0:1788305341.135672:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11543:x1875173741512192:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305341.135696:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305341.135716:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae914c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a6fa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.135810:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.135824:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.135849:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.135865:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.135873:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.135888:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136718:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136730:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136738:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305341.136748:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788305341.136859:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136867:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136873:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136891:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305341.136904:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136913:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136928:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305341.136930:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305341.136936:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136942:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ee00/0x902a3611c9ae9153 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136958:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136965:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136971:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136975:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305341.136978:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.136983:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.137654:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fbb5e39200) 00010000:00010000:1.0:1788305341.137660:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305341.137678:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.137686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae915a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.137757:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae914c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.137772:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.137779:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:1.0:1788305341.137782:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305341.137784:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f400, rc 0) 00000100:00100000:1.0:1788305341.138494:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+26:11543:x1875173741512192:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2821us (3039us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788305341.138504:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:1.0:1788305341.144217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305341.144380:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741512320 00000100:00100000:2.0:1788305341.144390:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741512320 00000100:00100000:2.0:1788305341.144508:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:2.0:1788305341.144521:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+26:11543:x1875173741512320:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1788305341.144596:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144613:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144627:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144654:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144661:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144668:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144673:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.144694:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144702:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144715:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:2.0:1788305341.144718:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305341.144722:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.144729:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae916f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305341.144830:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+26:11543:x1875173741512320:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 311us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305341.144838:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:1.0:1788305341.148401:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305341.148567:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741512576 00000100:00100000:3.0:1788305341.148579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741512576 00000100:00100000:3.0:1788305341.148650:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1788305341.148662:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+26:11543:x1875173741512576:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305341.148973:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+27:11543:x1875173741512576:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 313us (586us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788305341.148982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1788305341.202468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305341.202675:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741512832 00000100:00100000:2.0:1788305341.202685:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741512832 00000100:00100000:2.0:1788305341.202745:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:2.0:1788305341.202755:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+27:11068:x1875173741512832:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788305341.202780:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305341.202811:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9176 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a701 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.202938:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.202952:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.202979:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.203025:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.203039:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 28 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305341.203370:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761430400:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305341.203728:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305341.205808:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761430400:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305341.205844:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305341.206599:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305341.206663:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741512960 00000100:00100000:0.0:1788305341.206672:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741512960 00010000:00010000:0.0:1788305341.206717:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 29 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305341.206760:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:0.0:1788305341.206771:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+29:2347:x1875173741512960:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305341.206786:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305341.207620:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 29 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.207637:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 29 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.207661:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6fa expref: 29 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.207681:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:0.0:1788305341.207687:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.207697:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.207705:0:8499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.207748:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305341.207821:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+28:2347:x1875173741512960:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1050us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305341.207830:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00010000:00010000:1.0:1788305341.208196:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.208205:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305341.208227:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788305341.208381:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9176 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.208412:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.208420:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:1.0:1788305341.208422:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305341.208425:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044400, rc 0) 00000100:00100000:1.0:1788305341.208475:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+28:11068:x1875173741512832:12345-192.168.201.38@tcp:101:bash.0 Request processed in 5720us (6016us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788305341.208482:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:3.0:1788305341.213164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.213450:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741513216 00000100:00100000:1.0:1788305341.213460:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741513216 00000100:00100000:1.0:1788305341.213532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 192 00000100:00100000:1.0:1788305341.213543:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+28:11068:x1875173741513216:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:1.0:1788305341.213795:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.213811:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.213822:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305341.213873:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1788305341.213913:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b06e1f8 reply state 00000000128cc812 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.213922:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788305341.213990:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1788305341.214531:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11068:x1875173741513216:12345-192.168.201.38@tcp:36:bash.0 Request processed in 989us (1377us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788305341.214537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 192 00000020:00080000:1.0:1788305341.214542:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788305341.217097:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.217116:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.217132:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.217139:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fa00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305341.217145:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.217153:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.217172:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:0.0:1788305341.217175:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305341.217180:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.217186:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae918b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305341.219255:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.219319:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741513344 00000100:00100000:1.0:1788305341.219329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741513344 00000100:00100000:1.0:1788305341.219393:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:1.0:1788305341.219403:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+31:11068:x1875173741513344:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305341.219426:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305341.219445:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae9192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a708 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.219513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae9192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a708 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.219526:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae9192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a708 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.219543:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:1.0:1788305341.219546:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305341.219550:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e800, rc 0) 00000100:00100000:1.0:1788305341.219611:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11068:x1875173741513344:12345-192.168.201.38@tcp:101:bash.0 Request processed in 209us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305341.219617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:2.0:1788305341.224590:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.224697:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741513472 00000100:00100000:1.0:1788305341.224709:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741513472 00000100:00100000:1.0:1788305341.224779:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:1.0:1788305341.224791:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:11068:x1875173741513472:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305341.224832:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305341.224862:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a70f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305341.224901:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a975fb8, atime: 0x6a975fb7, ctime: 0x6a975fb8, blocks: 0xb 00010000:00010000:1.0:1788305341.224924:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1788305341.224929:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305341.224939:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.224960:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.224975:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ee00, rc 0) 00000100:00100000:1.0:1788305341.225044:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:11068:x1875173741513472:12345-192.168.201.38@tcp:101:bash.0 Request processed in 254us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305341.225084:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:3.0:1788305341.227825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305341.228568:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741513600 00000100:00100000:0.0:1788305341.228580:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741513600 00002000:00010000:0.0:1788305341.228642:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788305341.228647:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbb9f6d180 with x1875173741513600 ext(0->18446744073709551615) 00002000:00010000:0.0:1788305341.228658:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbb9f6d180. 00000100:00100000:0.0:1788305341.228765:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788305341.228778:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2350:x1875173741513600:12345-192.168.201.38@tcp:10:bash.0 00002000:00010000:0.0:1788305341.229104:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788305341.229108:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788305336 -> 1788305340 00002000:00010000:0.0:1788305341.229111:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788305335 -> 1788305335 00002000:00010000:0.0:1788305341.229114:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788305336 -> 1788305340 00002000:00010000:0.0:1788305341.229116:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788305341.229196:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2350:x1875173741513600:12345-192.168.201.38@tcp:10:bash.0 Request processed in 420us (1380us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788305341.229203:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00002000:00010000:0.0:1788305341.229207:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788305341.229210:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbb9f6d180 with x1875173741513600 ext(0->18446744073709551615) 00002000:00010000:0.0:1788305341.229215:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbb9f6d180. 00010000:00010000:2.0:1788305341.297274:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305341.334690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305341.335115:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741513728 00000100:00100000:2.0:1788305341.335126:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741513728 00000100:00100000:2.0:1788305341.335191:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:2.0:1788305341.335202:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11557:x1875173741513728:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:2.0:1788305341.335272:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335300:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335312:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335328:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335353:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335360:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335664:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335674:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335680:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305341.335719:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335742:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335749:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335756:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335762:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.335766:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335773:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335805:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305341.335808:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.335813:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335820:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae91a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335836:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335842:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335848:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335853:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.335856:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335861:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335868:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb88992f00) 00010000:00010000:2.0:1788305341.335870:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.335872:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335888:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae91a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335914:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335919:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335925:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335929:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.335932:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335937:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335944:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:2.0:1788305341.335946:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.335949:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.335954:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae91ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305341.336036:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11557:x1875173741513728:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 835us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305341.336046:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:1.0:1788305341.399992:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305341.400947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741513984 00000100:00100000:3.0:1788305341.400959:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741513984 00000100:00100000:3.0:1788305341.401224:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:3.0:1788305341.401251:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11560:x1875173741513984:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305341.401271:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305341.401403:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae91b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a716 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401480:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401494:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401505:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401519:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401525:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401532:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401872:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae91ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401892:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae91ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.401900:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae91ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305341.401921:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788305341.402029:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402037:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402043:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402049:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305341.402419:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402428:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402441:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305341.402444:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305341.402448:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402454:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae91bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402466:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402472:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402489:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402494:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbca00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305341.402497:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402502:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402510:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88900) 00010000:00010000:3.0:1788305341.402512:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305341.402514:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402519:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae91c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402566:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae91b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a716 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402579:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae91ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a716 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.402586:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:3.0:1788305341.402588:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305341.402590:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd800, rc 0) 00000100:00100000:3.0:1788305341.402678:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11560:x1875173741513984:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1429us (2693us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788305341.402697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:3.0:1788305341.407514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.407637:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741514112 00000100:00100000:1.0:1788305341.407649:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741514112 00000100:00100000:1.0:1788305341.407776:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:1.0:1788305341.407798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11560:x1875173741514112:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788305341.407872:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.407919:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.407942:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.407977:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.408000:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 34 pid: 5832 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.408015:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761430528:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305341.408143:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305341.418695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305341.418943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741514368 00000100:00100000:3.0:1788305341.418953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741514368 00000100:00100000:3.0:1788305341.419164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788305341.419176:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+35:5587:x1875173741514368:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788305341.419910:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761430528:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305341.419928:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+36:5587:x1875173741514368:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 755us (1244us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788305341.419937:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00010000:00010000:0.0:1788305341.419937:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305341.426552:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.426724:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741514496 00000100:00100000:1.0:1788305341.426734:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741514496 00010000:00010000:1.0:1788305341.426776:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 36 pid: 5832 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.426913:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:1.0:1788305341.426925:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb83071850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+36:2348:x1875173741514496:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305341.426942:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305341.426950:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 36 pid: 5832 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.426964:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 36 pid: 5832 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.426997:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae917d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a701 expref: 36 pid: 5832 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.427863:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:1.0:1788305341.427882:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.427895:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.427904:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.427942:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305341.428024:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428034:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428114:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428140:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428146:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428152:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305341.428157:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428164:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428175:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:0.0:1788305341.428178:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305341.428181:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.428186:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae91d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305341.428244:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+35:11560:x1875173741514112:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 20456us (20737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305341.428254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:1.0:1788305341.428591:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb83071850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+34:2348:x1875173741514496:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1666us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305341.428600:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:3.0:1788305341.433610:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.433909:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741514752 00000100:00100000:1.0:1788305341.433919:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741514752 00000100:00100000:1.0:1788305341.433982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1788305341.434002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+34:11560:x1875173741514752:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788305341.434276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+35:11560:x1875173741514752:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 276us (674us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788305341.434284:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:2.0:1788305341.698897:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305341.699526:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741515008 00000100:00100000:0.0:1788305341.699539:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741515008 00000100:00100000:0.0:1788305341.699658:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:0.0:1788305341.699672:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+35:11571:x1875173741515008:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788305341.699699:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305341.699735:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae91df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a71d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.699805:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.699821:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.699832:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.699847:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.699853:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.699860:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700243:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae91f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700253:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae91f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700261:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae91f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305341.700271:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788305341.700375:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700392:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700398:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700404:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305341.700409:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700416:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700428:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305341.700432:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305341.700436:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700442:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae91e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700454:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700460:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700465:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700470:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305341.700480:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700486:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700494:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fba21afb00) 00010000:00010000:0.0:1788305341.700497:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305341.700500:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700505:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae91ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700547:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae91df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a71d expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700560:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae91f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a71d expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.700568:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:0.0:1788305341.700570:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305341.700572:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfa00, rc 0) 00000100:00100000:0.0:1788305341.700652:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11571:x1875173741515008:12345-192.168.201.38@tcp:101:cat.0 Request processed in 983us (1767us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788305341.700660:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:2.0:1788305341.712605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305341.712920:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741515264 00000100:00100000:3.0:1788305341.712931:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741515264 00000100:00100000:3.0:1788305341.712990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:3.0:1788305341.713002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11571:x1875173741515264:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:3.0:1788305341.713563:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+38:11571:x1875173741515264:12345-192.168.201.38@tcp:35:cat.0 Request processed in 559us (975us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788305341.713572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:1.0:1788305341.746502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305341.746906:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741515520 00000100:00100000:2.0:1788305341.746920:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741515520 00000100:00100000:2.0:1788305341.746995:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 198 00000100:00100000:2.0:1788305341.747006:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+38:11572:x1875173741515520:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:2.0:1788305341.747121:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788305341.747149:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae91f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a71d expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747171:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd800/0x902a3611c9ae91ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a716 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747184:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae9192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a708 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747194:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fbb5e39000) 00010000:00010000:2.0:1788305341.747207:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305341.747236:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747252:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747263:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747280:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747299:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747326:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747633:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747642:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.747650:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305341.749635:0:8201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788305341.749652:0:8201:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359459597785ns, next at 360459594332ns, rc = 0 00010000:00010000:2.0:1788305341.749922:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.749938:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.749949:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.749957:0:8201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.749963:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.749969:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750011:0:8201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305341.750035:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750041:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750046:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750077:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.750277:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750551:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750565:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992900) 00010000:00010000:2.0:1788305341.750569:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788305341.750574:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750580:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9210 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750604:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750610:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750615:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750628:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305341.750631:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750636:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750644:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305341.750647:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305341.750650:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305341.750656:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9202 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305341.750666:0:8201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c49967fa reply state 0000000034b9712b transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305341.750676:0:8201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305341.750878:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+37:11572:x1875173741515520:12345-192.168.201.38@tcp:36:rm.0 Request processed in 3860us (4370us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788305341.750888:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 198 00010000:00010000:3.0:1788305341.751008:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305341.751015:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.751022:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305341.751026:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.751044:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.751103:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96fb88992900) 00010000:00010000:3.0:1788305341.751107:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788305341.751110:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.751116:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae9217 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.751134:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305341.751136:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305341.751138:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305341.760685:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.760702:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.760736:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.760744:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305341.760749:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.760757:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.760773:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb88992f00) 00010000:00010000:0.0:1788305341.760776:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305341.760779:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.760785:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9209 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.838187:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305341.838861:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741515776 00000100:00100000:3.0:1788305341.838882:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741515776 00000100:00100000:3.0:1788305341.839215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:3.0:1788305341.839228:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+36:11578:x1875173741515776:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305341.839257:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305341.839291:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae921e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a724 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.839435:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.839452:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.839463:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.839497:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.839505:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.839512:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305341.840142:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788305341.840342:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840356:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840364:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840405:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840412:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840418:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840424:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305341.840429:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840447:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840461:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305341.840464:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305341.840470:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840476:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9225 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305341.840489:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aebe1d62 reply state 000000005226b417 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305341.840498:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788305341.840528:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc800/0x902a3611c9ae921e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840543:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.840550:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:3.0:1788305341.840552:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305341.840554:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd600, rc 0) 00000100:00100000:3.0:1788305341.840656:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+39:11578:x1875173741515776:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1430us (2477us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788305341.840666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00010000:00010000:0.0:1788305341.844856:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.844887:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.844896:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.844902:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbca00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305341.844908:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.844940:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.844962:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb87f88900) 00010000:00010000:0.0:1788305341.844964:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305341.844969:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.844974:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae922c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.848199:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305341.848485:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741515904 00000100:00100000:3.0:1788305341.848502:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741515904 00000100:00100000:3.0:1788305341.848570:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788305341.848581:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741515904:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1788305341.848598:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305341.848619:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a72b expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305341.848648:0:11977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788305341.848668:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788305341.848673:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305341.848683:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 6 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.848701:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 6 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305341.848715:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc800, rc 0) 00000100:00100000:3.0:1788305341.848778:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741515904:12345-192.168.201.38@tcp:101:bash.0 Request processed in 198us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305341.848785:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:2.0:1788305341.853840:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305341.854010:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741516032 00000100:00100000:1.0:1788305341.854020:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741516032 00000100:00100000:1.0:1788305341.854121:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1788305341.854147:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:11578:x1875173741516032:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305341.854167:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305341.854188:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a732 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.854223:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 7 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.854232:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305341.854236:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305341.854241:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.854277:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 7 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.854461:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 7 pid: 11977 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.854478:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875173761430656:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305341.854582:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305341.858316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305341.858485:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741516160 00000100:00100000:0.0:1788305341.858496:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741516160 00010000:00010000:0.0:1788305341.858547:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 8 pid: 11977 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305341.858590:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:0.0:1788305341.858600:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741516160:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305341.858616:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305341.858644:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 8 pid: 11977 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.858658:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 8 pid: 11977 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.858685:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305341.858689:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305341.858710:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.858720:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305341.858774:0:8499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305341.858788:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83230a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8499:1875173761430784:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788305341.858887:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb857e30c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788305341.859763:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186a8706/0x902a3611c9ae9241 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a72b expref: 8 pid: 11977 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305341.859782:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875173761430656:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305341.859825:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305341.859839:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f600, rc 0) 00000100:00100000:1.0:1788305341.859909:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:11578:x1875173741516032:12345-192.168.201.38@tcp:101:bash.0 Request processed in 5764us (6079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305341.859920:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:2.0:1788305341.871417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305341.871624:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83230a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8499:1875173761430784:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788305341.871659:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305341.871737:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741516160:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 13137us (13430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305341.871749:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:3.0:1788305341.871832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741516416 00000100:00100000:3.0:1788305341.871839:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741516416 00000100:00100000:3.0:1788305341.871897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1788305341.871908:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+38:11578:x1875173741516416:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1788305341.872494:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+39:11578:x1875173741516416:12345-192.168.201.38@tcp:35:bash.0 Request processed in 371us (869us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788305341.872523:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1788305342.089688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305342.089879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.089971:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741516672 00000100:00100000:1.0:1788305342.089984:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741516672 00000100:00100000:1.0:1788305342.090105:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:1.0:1788305342.090119:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741516672:12345-192.168.201.38@tcp:16:kworker.0 00000100:00100000:1.0:1788305342.090260:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741516672:12345-192.168.201.38@tcp:16:kworker.0 Request processed in 145us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305342.090268:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00080000:3.0:1788305342.091802:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305342.099981:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741516544 00000100:00100000:0.0:1788305342.100000:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741516544 00002000:00100000:0.0:1788305342.100209:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff96fba0598a80 x1875173741516544/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:273/0 lens 504/0 e 0 to 0 dl 1788305353 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305342.100220:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fba0598a80 with x1875173741516544 ext(0->8) 00002000:00010000:0.0:1788305342.100227:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96fba0598a80 00000100:00100000:0.0:1788305342.100269:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1788305342.100613:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2347:x1875173741516544:12345-192.168.201.38@tcp:4:bash.0 00000100:00100000:0.0:1788305342.101877:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741516544:12345-192.168.201.38@tcp:4:bash.0 Request processed in 1584us (12184us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788305342.101896:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00002000:00100000:0.0:1788305342.101908:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff96fba0598a80 x1875173741516544/t4294967308(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:273/0 lens 504/448 e 0 to 0 dl 1788305353 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305342.101918:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fba0598a80 with x1875173741516544 ext(0->8) 00002000:00010000:0.0:1788305342.101923:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96fba0598a80 00000100:00100000:3.0:1788305342.118167:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.118425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741516800 00000100:00100000:0.0:1788305342.118436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741516800 00000100:00100000:0.0:1788305342.118517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:0.0:1788305342.118533:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+39:11594:x1875173741516800:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305342.118556:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305342.118577:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae924f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.118641:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae9256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.118655:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae9256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.118666:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae9256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305342.118820:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788305342.118923:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788305342.118927:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305342.118954:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae9256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.118981:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae924f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a739 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.119014:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae9256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a739 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.119023:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305342.119026:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305342.119029:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be600, rc 0) 00000100:00100000:0.0:1788305342.119321:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+40:11594:x1875173741516800:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 792us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.119328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:2.0:1788305342.124532:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.124606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741517056 00000100:00100000:0.0:1788305342.124616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741517056 00000100:00100000:0.0:1788305342.124681:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:0.0:1788305342.124692:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+40:11594:x1875173741517056:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305342.124711:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305342.124743:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae925d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a740 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.124845:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae9264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.124858:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae9264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.124882:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae9264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305342.124892:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788305342.125037:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae925d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a740 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.125098:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae9264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a740 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.125108:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:0.0:1788305342.125111:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305342.125115:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf400, rc 0) 00000100:00100000:0.0:1788305342.125192:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+42:11594:x1875173741517056:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 501us (670us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788305342.125200:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:2.0:1788305342.130691:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.130793:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741517312 00000100:00100000:0.0:1788305342.130803:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741517312 00000100:00100000:0.0:1788305342.130881:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 202 00000100:00100000:0.0:1788305342.130893:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+42:11594:x1875173741517312:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305342.130916:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305342.130937:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a747 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.131034:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.131049:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.131113:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305342.131146:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788305342.131294:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a747 expref: 45 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.131314:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a747 expref: 44 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.131323:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:0.0:1788305342.131326:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788305342.131330:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfa00, rc 0) 00000100:00100000:0.0:1788305342.131387:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+44:11594:x1875173741517312:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 496us (707us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788305342.131394:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 202 00000100:00100000:1.0:1788305342.140249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305342.140404:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741517440 00000100:00100000:3.0:1788305342.140414:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741517440 00000100:00100000:3.0:1788305342.140490:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1788305342.140500:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+44:2347:x1875173741517440:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305342.140517:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305342.140549:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf400/0x902a3611c9ae9264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a740 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.140574:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:3.0:1788305342.140579:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305342.140649:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+43:2347:x1875173741517440:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 151us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305342.140657:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1788305342.146174:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.146415:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741517568 00000100:00100000:1.0:1788305342.146426:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741517568 00000100:00100000:1.0:1788305342.146486:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:1.0:1788305342.146497:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2350:x1875173741517568:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:1.0:1788305342.146542:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.146562:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.146571:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305342.146585:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305342.146591:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.146628:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.146641:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 8 pid: 6678 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.146654:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875173761430912:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305342.146743:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305342.149848:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875173761430912:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305342.149891:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305342.153536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.153799:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741517696 00000100:00100000:1.0:1788305342.153812:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741517696 00010000:00010000:1.0:1788305342.153858:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 9 pid: 6678 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.153914:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:1.0:1788305342.153926:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2347:x1875173741517696:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305342.153942:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788305342.153967:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788305342.153969:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788305341 00002000:00010000:1.0:1788305342.153980:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788305341 00010000:00010000:1.0:1788305342.153987:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 9 pid: 6678 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.154001:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 9 pid: 6678 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.154025:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d28112e/0x902a3611c9ae9248 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a732 expref: 9 pid: 6678 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.154044:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305342.154048:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305342.154250:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.154263:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.154415:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305342.154495:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741517696:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 569us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305342.154504:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00010000:00010000:2.0:1788305342.154643:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154653:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154681:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154689:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154696:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154703:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305342.154717:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154726:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154739:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.154745:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae9287 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305342.154808:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2350:x1875173741517568:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 8312us (8646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305342.154817:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1788305342.159230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.159379:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741517952 00000100:00100000:1.0:1788305342.159390:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741517952 00000100:00100000:1.0:1788305342.159449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:1.0:1788305342.159460:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+43:11594:x1875173741517952:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1788305342.159524:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a747 expref: 43 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305342.159799:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788305342.159847:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788305342.160844:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1788305342.160941:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.160964:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.160974:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.161020:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.161038:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 47 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.162161:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875173761431040:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305342.162357:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305342.165587:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875173761431040:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305342.165628:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305342.167614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305342.167857:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741518080 00000100:00100000:3.0:1788305342.167877:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741518080 00010000:00010000:3.0:1788305342.167921:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 48 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305342.167964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1788305342.167974:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+48:2347:x1875173741518080:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305342.168012:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305342.168021:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 48 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.168036:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 48 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.168114:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a724 expref: 48 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.168131:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:3.0:1788305342.168136:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.168145:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.168152:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305342.168398:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305342.168475:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+47:2347:x1875173741518080:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 499us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305342.168483:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00010000:00010000:2.0:1788305342.170951:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.170970:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305342.171423:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788305342.171693:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788305342.171948:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbbb414000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761431168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788305342.172041:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305342.172507:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305342.172605:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761431168 00000100:00100000:0.0:1788305342.172614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761431168 00000100:00100000:0.0:1788305342.172750:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305342.172762:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875173761431168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788305342.172883:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875173761431168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.172892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305342.172996:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbbb414000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761431168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788305342.173596:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788305342.173683:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761431296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788305342.173734:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305342.173768:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba2425cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305342.174010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761431296 00000100:00100000:0.0:1788305342.174018:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761431296 00000100:00100000:0.0:1788305342.174099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305342.174109:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875173761431296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788305342.174294:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1875173761431296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 187us (559us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788305342.174313:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305342.174606:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875173761431296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788305342.174666:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788305342.174706:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.174717:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.174725:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.174731:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305342.174735:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.174742:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.174757:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:1.0:1788305342.174760:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788305342.174764:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.174770:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae928e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305342.174991:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788305342.175157:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788305342.175170:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359885115822ns, next at 360885113272ns, rc = 0 00000001:00080000:1.0:1788305342.175185:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788305342.175230:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fb87f88700) 00010000:00010000:1.0:1788305342.175234:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788305342.175242:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9279 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a747 expref: 51 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.176583:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+50:11594:x1875173741517952:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 17115us (17354us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788305342.176596:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000020:00080000:1.0:1788305342.176603:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788305342.181912:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305342.182797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.182926:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741518208 00000100:00100000:0.0:1788305342.182936:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741518208 00000100:00100000:0.0:1788305342.187493:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:0.0:1788305342.187573:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+50:11594:x1875173741518208:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305342.187605:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305342.187638:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a74e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.187737:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a74e expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.187756:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a74e expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.187781:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.187785:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305342.187789:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfc00, rc 0) 00000100:00100000:0.0:1788305342.187892:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+51:11594:x1875173741518208:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 377us (5183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.187899:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:2.0:1788305342.192199:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305342.192294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741518464 00000100:00100000:3.0:1788305342.192306:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741518464 00000100:00100000:3.0:1788305342.192375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1788305342.192387:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+51:11594:x1875173741518464:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305342.192677:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11594:x1875173741518464:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 292us (488us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788305342.192684:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000001:00080000:1.0:1788305342.321866:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788305342.321886:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1788305342.322187:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305342.356586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.356705:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741518592 00000100:00100000:0.0:1788305342.356726:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741518592 00000100:00100000:0.0:1788305342.356794:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 204 00000100:00100000:0.0:1788305342.356805:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11604:x1875173741518592:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1788305342.356904:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.356937:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.356949:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.356965:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.356972:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.356979:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357249:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357258:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357265:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305342.357390:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357404:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357411:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357430:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357437:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305342.357442:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357449:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357463:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305342.357466:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305342.357470:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357477:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae929c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357490:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357497:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357502:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357519:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305342.357523:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357539:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357548:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fba21afd00) 00010000:00010000:0.0:1788305342.357550:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305342.357553:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357560:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357576:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357582:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357587:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357592:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305342.357594:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357600:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357607:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.357609:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305342.357612:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.357628:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305342.357703:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11604:x1875173741518592:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 898us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.359697:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 204 00000100:00100000:3.0:1788305342.395537:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.401556:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741518848 00000100:00100000:1.0:1788305342.401571:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741518848 00000100:00100000:0.0:1788305342.401736:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:0.0:1788305342.401749:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb5d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+52:11607:x1875173741518848:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305342.401769:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305342.401791:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a755 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.401890:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.401906:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.401917:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.401933:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.401940:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.401945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402503:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae92c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402521:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305342.402530:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788305342.402628:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402636:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402643:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402648:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305342.402652:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402659:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402671:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:0.0:1788305342.402674:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305342.402679:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402695:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae92b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402709:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402782:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402789:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402793:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305342.402796:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402802:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402811:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fba21afd00) 00010000:00010000:0.0:1788305342.402814:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305342.402816:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402823:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae92bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402875:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae92b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a755 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402889:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae92c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a755 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.402903:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.402906:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305342.402909:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be800, rc 0) 00000100:00100000:0.0:1788305342.403129:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb5d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+54:11607:x1875173741518848:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1382us (7608us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788305342.403137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:2.0:1788305342.419833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.419962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741518976 00000100:00100000:1.0:1788305342.419982:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741518976 00000100:00100000:1.0:1788305342.420042:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:1.0:1788305342.420087:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:11607:x1875173741518976:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788305342.420160:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420179:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420190:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420217:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420243:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420249:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420255:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305342.420260:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420267:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420280:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.420283:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305342.420288:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.420294:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.420385:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:11607:x1875173741518976:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 332us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305342.420393:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:3.0:1788305342.434573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.436364:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741519232 00000100:00100000:0.0:1788305342.436379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741519232 00000100:00100000:0.0:1788305342.436458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:0.0:1788305342.436472:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+54:11607:x1875173741519232:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1788305342.437034:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11607:x1875173741519232:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 560us (2479us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788305342.437043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:3.0:1788305342.642175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.642332:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741519488 00000100:00100000:1.0:1788305342.642343:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741519488 00000100:00100000:1.0:1788305342.642407:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:1.0:1788305342.642435:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+55:11617:x1875173741519488:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305342.642462:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305342.642483:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788305342.642521:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae9256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a739 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.642545:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305342.642551:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305342.642566:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a75c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.642674:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.642688:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.642700:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305342.642713:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788305342.642882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a75c expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.642898:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a75c expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.642907:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.642909:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305342.642912:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f000, rc 0) 00000100:00100000:1.0:1788305342.642980:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11617:x1875173741519488:12345-192.168.201.38@tcp:101:bash.0 Request processed in 563us (814us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788305342.642998:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:3.0:1788305342.650544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.650647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741519744 00000100:00100000:1.0:1788305342.650656:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741519744 00000100:00100000:1.0:1788305342.650724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:1.0:1788305342.650735:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11617:x1875173741519744:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:1.0:1788305342.650801:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788305342.650828:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a75c expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.650851:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be800/0x902a3611c9ae92c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a755 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.650875:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.650880:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305342.651152:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.651167:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.651178:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305342.651231:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1788305342.651259:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036b1553f reply state 0000000026a53b9a transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.651267:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305342.651374:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11617:x1875173741519744:12345-192.168.201.38@tcp:36:bash.0 Request processed in 640us (839us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788305342.651382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000020:00080000:1.0:1788305342.651387:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788305342.657096:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.657115:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.657122:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.657128:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305342.657133:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.657141:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.657175:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.657178:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305342.657183:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.657190:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae92f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305342.662870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.663721:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741519872 00000100:00100000:1.0:1788305342.663732:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741519872 00000100:00100000:1.0:1788305342.664361:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:1.0:1788305342.664374:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+56:11617:x1875173741519872:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1788305342.664400:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305342.664562:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a763 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.664653:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.664666:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.664679:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305342.664707:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788305342.664712:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305342.664729:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.664912:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae92f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.664934:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.665215:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.665220:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305342.665225:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305342.665366:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11617:x1875173741519872:12345-192.168.201.38@tcp:101:bash.0 Request processed in 993us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305342.665373:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:3.0:1788305342.670309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.671443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741520128 00000100:00100000:0.0:1788305342.671457:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741520128 00000100:00100000:0.0:1788305342.671549:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1788305342.671561:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+57:11617:x1875173741520128:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:0.0:1788305342.672362:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+58:11617:x1875173741520128:12345-192.168.201.38@tcp:35:bash.0 Request processed in 799us (2057us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788305342.672372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1788305342.914466:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.914707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741520256 00000100:00100000:1.0:1788305342.914718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741520256 00000100:00100000:1.0:1788305342.914785:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:1.0:1788305342.914796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+58:11623:x1875173741520256:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305342.914823:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305342.914867:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a76a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.914937:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae930c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.914953:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae930c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.914978:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae930c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305342.915046:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788305342.915050:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305342.915111:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae930c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.915157:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a76a expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.915177:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae930c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a76a expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.915186:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305342.915189:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305342.915193:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fa00, rc 0) 00000100:00100000:1.0:1788305342.915246:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11623:x1875173741520256:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 453us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305342.915253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:3.0:1788305342.928897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.929218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741520384 00000100:00100000:1.0:1788305342.929229:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741520384 00000100:00100000:1.0:1788305342.929287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:1.0:1788305342.929299:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11623:x1875173741520384:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305342.929319:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305342.929341:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9313 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a771 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.929409:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.929423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.929437:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.929472:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.929493:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.929501:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931628:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931647:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931659:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305342.931704:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788305342.931708:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305342.931728:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931741:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931751:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931758:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931784:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931790:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305342.931794:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931801:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931814:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305342.931818:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305342.931822:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931840:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae931a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931866:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931873:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931878:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931883:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305342.931886:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931903:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931912:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fbb5e39700) 00010000:00010000:1.0:1788305342.931915:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305342.931917:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931922:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.931992:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae9313 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.932008:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.932016:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.932019:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305342.932022:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f600, rc 0) 00000100:00100000:1.0:1788305342.932116:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+60:11623:x1875173741520384:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2818us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305342.932125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:3.0:1788305342.944421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305342.945387:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741520640 00000100:00100000:1.0:1788305342.945402:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741520640 00000100:00100000:1.0:1788305342.945474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:1.0:1788305342.945495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+60:11623:x1875173741520640:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305342.945537:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305342.945560:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae932f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a778 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946527:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946552:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946561:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946579:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946620:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946636:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 61 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.946653:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761431424:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305342.946799:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.946810:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.950042:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761431552:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305342.950206:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba2425cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305342.956778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.957290:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741520768 00000100:00100000:0.0:1788305342.957301:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741520768 00010000:00010000:0.0:1788305342.957350:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 62 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305342.957405:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:0.0:1788305342.957417:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+62:2347:x1875173741520768:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305342.957435:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305342.957444:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 62 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.957459:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 62 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.957501:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.957506:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.957516:0:8499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.957522:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305342.957592:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+62:2347:x1875173741520768:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 177us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.957599:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:3.0:1788305342.960028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:1.0:1788305342.960148:0:5833:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.38@tcp) returned -22 from blocking AST (req@0000000014d61477 x1875173761431424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 61 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.960172:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f600/0x902a3611c9ae9328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a771 expref: 61 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305342.960191:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761431424:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305342.960205:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761431552:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305342.960231:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.960236:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.960244:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.960254:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305342.960358:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741520896 00000100:00100000:0.0:1788305342.960366:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741520896 00010000:00010000:0.0:1788305342.960403:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305342.960440:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:0.0:1788305342.960452:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+61:2350:x1875173741520896:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305342.960466:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305342.960472:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.960485:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.960505:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae92fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a763 expref: 61 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.960533:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.960537:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.960544:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.960552:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.960589:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305342.960645:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+60:2350:x1875173741520896:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 194us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.960653:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00010000:00010000:1.0:1788305342.961201:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.961210:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305342.961242:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788305342.961391:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f400/0x902a3611c9ae932f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.961408:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305342.961415:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305342.961418:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305342.961420:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071fc00, rc 0) 00000100:00100000:1.0:1788305342.961453:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+60:11623:x1875173741520640:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 15960us (17043us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788305342.961460:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:2.0:1788305342.969366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.969460:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741521152 00000100:00100000:0.0:1788305342.969471:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741521152 00000100:00100000:0.0:1788305342.969579:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1788305342.969592:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb873e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+60:11623:x1875173741521152:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:0.0:1788305342.969607:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305342.969634:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a74e expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.969656:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.969661:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305342.969749:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb873e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11623:x1875173741521152:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 159us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.969758:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1788305342.972391:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305342.972477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741521280 00000100:00100000:2.0:1788305342.972490:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741521280 00000100:00100000:2.0:1788305342.972561:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:2.0:1788305342.972573:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11623:x1875173741521280:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:2.0:1788305342.972685:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.972733:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305342.972744:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305342.972992:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788305342.973144:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11623:x1875173741521280:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 568us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305342.973153:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:3.0:1788305342.976488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305342.976553:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741521408 00000100:00100000:0.0:1788305342.976564:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741521408 00000100:00100000:0.0:1788305342.976644:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:0.0:1788305342.976655:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+59:11623:x1875173741521408:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1788305342.976675:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305342.977166:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a77f expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.977242:0:8201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.977254:0:8201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 60 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.977273:0:8201:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.977288:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 60 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.977301:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305342.977315:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305342.977320:0:8201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 60 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305342.977328:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf200, rc 0) 00000100:00100000:0.0:1788305342.977392:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+60:11623:x1875173741521408:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 738us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305342.977400:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 214 00010000:00010000:3.0:1788305343.345336:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788305343.780391:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1788305343.780413:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1788305343.801463:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:3.0:1788305343.801504:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:3.0:1788305343.801522:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788305343.801757:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761431680:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788305343.801830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305343.801970:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761431680 00000100:00100000:2.0:1788305343.801978:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761431680 00000100:00100000:2.0:1788305343.802029:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305343.802037:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761431680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788305343.802087:0:11977:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788305343.802117:0:11977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a975fbd, atime: 0x0, ctime: 0x6a975fbd, blocks: 0xb 00010000:00010000:2.0:1788305343.802125:0:11977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.802140:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788305343.802144:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305343.802150:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.802166:0:11977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.802194:0:11977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.802202:0:11977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.802218:0:11977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788305343.802965:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fb88a5ad80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788305343.802971:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb8730c400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fb88a5ae40 00000020:00080000:3.0:1788305343.802975:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb8730cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fbc1306c00 00000004:00080000:3.0:1788305343.803019:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788305343.803076:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fb862cb840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788305343.803079:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb895ddb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fb862cb000 00000020:00080000:3.0:1788305343.803082:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb895dd700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fa81b39400 00000100:00100000:2.0:1788305343.803267:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761431680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1227us (1433us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788305343.803275:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:2.0:1788305343.803309:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305343.803316:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.803327:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305343.803332:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.803342:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.803359:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.803367:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001275cb1/0x902a3611c9ae9352 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.803392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305343.803394:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305343.803396:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305343.803494:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788305343.803499:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fb88f29f80, transno 4294967307 00000004:00080000:0.0:1788305343.803545:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1788305343.803570:0:3303:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff96fa81d0d500 x1875173761431680/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305359 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788305343.803582:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fa81d0d500/2, rc 0, transno 4294967310 00000020:00080000:2.0:1788305343.804502:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788305343.804626:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788305343.806273:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761431680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788305343.806462:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761431808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788305343.806537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305343.806630:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761431808 00000100:00100000:3.0:1788305343.806639:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761431808 00000100:00100000:3.0:1788305343.806696:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305343.806706:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761431808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788305343.806736:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788305343.806765:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.806788:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.806796:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1788305343.806800:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305343.806804:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.806845:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.806860:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 6 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305343.806872:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb87091880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875173761431936:192.168.201.38@tcp:104: 00000100:00100000:3.0:1788305343.806964:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862cb600 going to sleep for 11 seconds 00000100:00080000:3.0:1788305343.806981:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305343.810359:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305343.810591:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741521536 00000100:00100000:0.0:1788305343.810603:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741521536 00010000:00010000:0.0:1788305343.810671:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 7 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305343.810718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:0.0:1788305343.810730:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741521536:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305343.810746:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305343.810751:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 7 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.810765:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 7 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.810791:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305343.810796:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305343.810801:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.810846:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.810872:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305343.810934:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741521536:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 206us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305343.810941:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00010000:00010000:2.0:1788305343.811562:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b857fb44/0x902a3611c9ae9199 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a70f expref: 6 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305343.811579:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb87091880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875173761431936:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305343.811604:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.811616:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.811626:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.811637:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.811643:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.811677:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305343.812165:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305343.812176:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.812188:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305343.812194:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.812205:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.812236:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.812243:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae9359 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.812265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305343.812273:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305343.812275:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305343.812657:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305343.813708:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761431808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6994us (7162us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788305343.813723:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305343.814929:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788305343.814940:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1788305343.814971:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff96fa83230700 x1875173761431808/t4294967319(4294967319) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305359 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788305343.814986:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fa83230700/2, rc 0, transno 4294967319 00000100:00100000:1.0:1788305343.814991:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761431808:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1788305343.857821:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305343.857843:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305343.857893:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788305343.857904:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305343.858050:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761432064:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305343.858303:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb853fe540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305343.884029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305343.884266:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761432064:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305343.885572:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741521664 00000100:00100000:3.0:1788305343.885588:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741521664 00000100:00100000:3.0:1788305343.885661:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:3.0:1788305343.885673:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11625:x1875173741521664:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788305343.885722:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788305343.886116:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11625:x1875173741521664:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 444us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305343.886125:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:2.0:1788305343.898703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305343.906496:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741521792 00000100:00100000:1.0:1788305343.906515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741521792 00000100:00100000:1.0:1788305343.906669:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:1.0:1788305343.906681:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11625:x1875173741521792:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788305343.906775:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906803:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906815:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906896:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906904:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906941:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.906949:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305343.907024:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788305343.907030:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305343.907045:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907093:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907100:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907107:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907114:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305343.907119:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907127:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907140:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:1.0:1788305343.907143:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305343.907148:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907153:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f000/0x902a3611c9ae9360 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907168:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907184:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907191:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907196:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305343.907199:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907205:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907213:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff96fbb5e39700) 00010000:00010000:1.0:1788305343.907215:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305343.907217:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907235:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9367 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907252:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907257:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907263:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907267:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305343.907276:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907282:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907300:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305343.907303:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305343.907305:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.907310:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae936e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305343.907409:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11625:x1875173741521792:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 728us (8713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305343.907417:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:1.0:1788305343.917044:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305343.917216:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741522048 00000100:00100000:3.0:1788305343.917244:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741522048 00000100:00100000:3.0:1788305343.917584:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:3.0:1788305343.917597:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+18:11625:x1875173741522048:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305343.917621:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305343.917645:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9375 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a786 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.917770:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.917788:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.917802:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305343.917850:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788305343.918113:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918122:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918128:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918134:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305343.918137:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918145:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918160:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305343.918163:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305343.918167:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918173:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae937c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918219:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9375 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a786 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918584:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305343.918587:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305343.918601:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae9375 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a786 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.918611:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd600, rc 0) 00000100:00100000:3.0:1788305343.918719:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741522048:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1685us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1788305343.918726:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:2.0:1788305343.940844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305343.942278:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741522176 00000100:00100000:0.0:1788305343.942308:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741522176 00000100:00100000:0.0:1788305343.942400:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:0.0:1788305343.942412:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741522176:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788305343.942484:0:8201:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788305343.942621:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741522176:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 211us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305343.942630:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:0.0:1788305343.946839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305343.948597:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741522432 00000100:00100000:1.0:1788305343.948612:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741522432 00000100:00100000:2.0:1788305343.948898:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:2.0:1788305343.948912:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741522432:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305343.948939:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305343.948944:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305343.948980:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae930c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a76a expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.949001:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:2.0:1788305343.949006:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305343.949020:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae938a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a78d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305343.950876:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788305343.955876:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.955907:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.955945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.956038:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae938a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a78d expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.956091:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a78d expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305343.956100:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:2.0:1788305343.956103:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305343.956107:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045800, rc 0) 00000100:00100000:2.0:1788305343.956185:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741522432:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 7277us (9366us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788305343.956194:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:2.0:1788305343.962750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305343.962862:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741522688 00000100:00100000:1.0:1788305343.962873:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741522688 00000100:00100000:1.0:1788305343.962938:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:1.0:1788305343.962949:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741522688:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305343.963019:0:8201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305343.963048:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a78d expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963111:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305343.963122:0:8201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305343.963158:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963172:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963182:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963247:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963255:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963261:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963707:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963716:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963723:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963730:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305343.963734:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963741:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963763:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:1.0:1788305343.963766:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305343.963770:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963776:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e800/0x902a3611c9ae939f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963786:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963793:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963799:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963805:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305343.963808:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963813:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963820:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x66d1ed97 (ffff96fbb5e39700) 00010000:00010000:1.0:1788305343.963822:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305343.963825:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.963840:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x66d1ed97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305343.964219:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741522688:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1268us (1476us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305343.964475:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:0.0:1788305343.974136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305343.974325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741522816 00000100:00100000:3.0:1788305343.974336:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741522816 00000100:00100000:3.0:1788305343.974401:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:3.0:1788305343.974414:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741522816:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305343.974435:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305343.974460:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a794 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.974495:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.974510:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.974521:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.974621:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.974637:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305343.974656:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305343.974659:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305343.974662:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbce00, rc 0) 00000100:00100000:3.0:1788305343.974722:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741522816:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 310us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305343.974735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:2.0:1788305343.980791:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305343.980921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741523072 00000100:00100000:1.0:1788305343.980935:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741523072 00000100:00100000:1.0:1788305343.981006:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:1.0:1788305343.981017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741523072:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305343.981169:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.981189:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305343.981202:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305343.981662:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788305343.981675:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361691620758ns, next at 362691618267ns, rc = 0 00000004:00010000:1.0:1788305343.981763:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a715c96a reply state 00000000de4cbef3 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305343.981773:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305343.981968:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11625:x1875173741523072:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 951us (1187us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788305343.981977:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 222 00010000:00010000:0.0:1788305343.986702:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.986718:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.986731:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.986736:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305343.986741:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.986749:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.986771:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:0.0:1788305343.986774:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788305343.986795:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305343.986802:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae93bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305343.999628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305343.999815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741523200 00000100:00100000:3.0:1788305343.999827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741523200 00000100:00100000:3.0:1788305343.999901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:3.0:1788305343.999912:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11625:x1875173741523200:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305343.999941:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305343.999969:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a79b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.000041:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.000109:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.000133:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305344.000137:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305344.000141:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd600, rc 0) 00000100:00100000:3.0:1788305344.000203:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11625:x1875173741523200:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 293us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305344.000236:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:1.0:1788305344.008715:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.008937:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741523328 00000100:00100000:2.0:1788305344.008952:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741523328 00000100:00100000:2.0:1788305344.009103:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1788305344.009117:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+6:2348:x1875173741523328:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788305344.009479:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2348:x1875173741523328:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 365us (775us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788305344.009488:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:0.0:1788305344.021603:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305344.021813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741523584 00000100:00100000:1.0:1788305344.021849:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741523584 00000100:00100000:1.0:1788305344.021998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1788305344.022010:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:11625:x1875173741523584:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788305344.022345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11625:x1875173741523584:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 336us (753us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788305344.022353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00080000:3.0:1788305344.023509:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305344.043175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305344.043320:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741523840 00000100:00100000:1.0:1788305344.043331:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741523840 00000100:00100000:1.0:1788305344.043401:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:1.0:1788305344.043413:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11625:x1875173741523840:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788305344.043539:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11625:x1875173741523840:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 128us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305344.043547:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:2.0:1788305344.050160:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.050903:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741523968 00000100:00100000:3.0:1788305344.050919:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741523968 00000100:00100000:2.0:1788305344.051150:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:2.0:1788305344.051162:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11625:x1875173741523968:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305344.051192:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305344.051221:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae93c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7a2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.051327:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae93d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.051344:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae93d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.051359:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae93d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305344.051408:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305344.051432:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae93d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.051466:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044400/0x902a3611c9ae93c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a2 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.051488:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae93d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a2 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.051497:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:2.0:1788305344.051500:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788305344.051504:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044800, rc 0) 00000100:00100000:2.0:1788305344.051640:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11625:x1875173741523968:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 480us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.051664:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:0.0:1788305344.058889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.059180:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524096 00000100:00100000:3.0:1788305344.059194:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524096 00000100:00100000:3.0:1788305344.059387:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1788305344.059401:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741524096:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305344.059421:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305344.059448:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7a9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305344.059481:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a975fbf, blocks: 0x1 00010000:00010000:3.0:1788305344.059504:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788305344.059509:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305344.059520:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.059537:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.059552:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd200, rc 0) 00000100:00100000:3.0:1788305344.059627:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741524096:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 229us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305344.059634:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:0.0:1788305344.068484:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305344.068593:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524352 00000100:00100000:1.0:1788305344.068604:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524352 00000100:00100000:1.0:1788305344.068732:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:1.0:1788305344.068745:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11625:x1875173741524352:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788305344.068901:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11625:x1875173741524352:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 157us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305344.068909:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:1.0:1788305344.079210:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.079918:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524480 00000100:00100000:2.0:1788305344.079933:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524480 00000100:00100000:2.0:1788305344.080022:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:2.0:1788305344.080034:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:11625:x1875173741524480:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305344.080220:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305344.080243:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7b0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.080283:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.080293:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305344.080298:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305344.080303:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 9 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.080345:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.080361:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.080378:0:11977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761432192:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305344.081195:0:11977:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305344.095469:0:11977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761432192:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305344.095520:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 9 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.095546:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044400, rc 0) 00000100:00100000:2.0:1788305344.095663:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+9:11625:x1875173741524480:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 15630us (16464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.095673:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:1.0:1788305344.102407:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.102895:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524608 00000100:00100000:2.0:1788305344.102908:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524608 00010000:00010000:2.0:1788305344.102958:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.103015:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:2.0:1788305344.103025:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2348:x1875173741524608:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305344.103077:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305344.103108:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.103123:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.103147:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041ccac67/0x902a3611c9ae93d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a9 expref: 9 pid: 6677 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.103162:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305344.103179:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305344.103187:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.103198:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.103242:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.103258:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875173761432320:192.168.201.38@tcp:105: 00000100:00100000:2.0:1788305344.103342:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305344.107572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.107688:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875173761432320:192.168.201.38@tcp:105: 00010000:00010000:2.0:1788305344.107723:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305344.107786:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741524608:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4760us (5390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.107798:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:3.0:1788305344.109185:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524736 00000100:00100000:3.0:1788305344.109210:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524736 00002000:00100000:3.0:1788305344.109411:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96fa83233480 x1875173741524736/t0(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:275/0 lens 504/0 e 0 to 0 dl 1788305355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305344.109421:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fa83233480 with x1875173741524736 ext(0->12) 00002000:00010000:3.0:1788305344.109425:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fa83233480 00000100:00100000:3.0:1788305344.109475:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788305344.109483:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741524736:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788305344.109988:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2347:x1875173741524736:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 504us (2430us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788305344.109995:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00002000:00100000:3.0:1788305344.110007:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96fa83233480 x1875173741524736/t4294967321(0) o4->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:275/0 lens 504/448 e 0 to 0 dl 1788305355 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788305344.110012:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fa83233480 with x1875173741524736 ext(0->12) 00002000:00010000:3.0:1788305344.110015:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fa83233480 00000100:00100000:0.0:1788305344.119820:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.119985:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524864 00000100:00100000:3.0:1788305344.119997:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524864 00000100:00100000:3.0:1788305344.120101:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:3.0:1788305344.120111:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+24:11625:x1875173741524864:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788305344.170744:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1788305344.170764:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788305344.170787:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:0.0:1788305344.171072:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305344.171095:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761432448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305344.171176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788305344.171556:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1788305344.171574:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788305344.171978:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741524864:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 51863us (52169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.171991:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:2.0:1788305344.172359:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761432448 00000100:00100000:2.0:1788305344.172368:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761432448 00000100:00100000:2.0:1788305344.172457:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305344.172471:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761432448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788305344.172641:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788305344.172645:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788305343 00002000:00010000:2.0:1788305344.172661:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788305344.172663:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788305343 -> 1788305343 00002000:00010000:2.0:1788305344.172665:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788305344.172732:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875173761432448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (1555us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788305344.172739:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1788305344.173231:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fa83230000/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788305344.173239:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761432448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305344.178771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305344.179156:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741524992 00000100:00100000:1.0:1788305344.179165:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741524992 00000100:00100000:1.0:1788305344.179235:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788305344.179242:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2348:x1875173741524992:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788305344.206480:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788305344.206494:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788305344.206501:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788305344.206682:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2348:x1875173741524992:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 27426us (27908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305344.206694:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788305344.209251:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.209333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741525248 00000100:00100000:2.0:1788305344.209343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741525248 00000100:00100000:2.0:1788305344.209408:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:2.0:1788305344.209420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741525248:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305344.209490:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305344.209520:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae93d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7a2 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.209544:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:2.0:1788305344.209549:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305344.209577:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.209590:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.209599:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305344.209894:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf39eabe reply state 00000000471a0e45 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.209915:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305344.210017:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+21:11625:x1875173741525248:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 597us (771us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788305344.210024:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 228 00010000:00010000:0.0:1788305344.213399:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.213422:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.213430:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.213437:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305344.213442:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.213472:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.213492:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:0.0:1788305344.213495:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305344.213500:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.213506:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae93e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305344.214750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.214874:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741525376 00000100:00100000:3.0:1788305344.214888:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741525376 00000100:00100000:3.0:1788305344.214985:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1788305344.214996:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741525376:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788305344.215377:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788305344.215380:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788305343 -> 1788305342 00002000:00010000:3.0:1788305344.215383:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788305341 00002000:00010000:3.0:1788305344.215386:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788305343 -> 1788305342 00002000:00010000:3.0:1788305344.215388:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788305344.215465:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2347:x1875173741525376:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 470us (723us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788305344.215473:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:2.0:1788305344.219165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305344.219263:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741525632 00000100:00100000:0.0:1788305344.219274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741525632 00000100:00100000:0.0:1788305344.219345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:0.0:1788305344.219356:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11625:x1875173741525632:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788305344.219431:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.219445:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.219452:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.219481:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.219492:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 20 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305344.219522:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761432576:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305344.219618:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88a5ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305344.222934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.223117:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875173761432576:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305344.223155:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305344.223330:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741525760 00000100:00100000:3.0:1788305344.223341:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741525760 00010000:00010000:3.0:1788305344.223398:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305344.223449:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:3.0:1788305344.223462:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:2347:x1875173741525760:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305344.223484:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305344.223492:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.223506:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.223537:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae93b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a794 expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.223558:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305344.223581:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.223592:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.223600:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.223630:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305344.223777:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:2347:x1875173741525760:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 316us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305344.223785:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00010000:00010000:2.0:1788305344.223856:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223863:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223900:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223905:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223911:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223916:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305344.223920:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223927:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223945:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:2.0:1788305344.223948:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788305344.223951:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.223956:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be600/0x902a3611c9ae93ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.223998:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741525632:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 4644us (4843us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788305344.224006:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:1.0:1788305344.227412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.227488:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741525888 00000100:00100000:2.0:1788305344.227500:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741525888 00000100:00100000:2.0:1788305344.227562:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:2.0:1788305344.227574:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741525888:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788305344.227622:0:11977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.227646:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.227653:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305344.227657:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305344.227661:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.227706:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.227734:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 8 pid: 11977 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.227749:0:11977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761432704:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305344.227843:0:11977:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305344.231730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.231848:0:11977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11977:1875173761432704:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305344.231878:0:11977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305344.231961:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741526016 00000100:00100000:1.0:1788305344.231968:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741526016 00010000:00010000:1.0:1788305344.232004:0:8499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 9 pid: 11977 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305344.232075:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:1.0:1788305344.232086:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+9:2348:x1875173741526016:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305344.232355:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305344.232385:0:8499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 9 pid: 11977 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.232399:0:8499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 9 pid: 11977 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.232428:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005deb6812/0x902a3611c9ae93de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b0 expref: 9 pid: 11977 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.232448:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305344.232473:0:8499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305344.232480:0:8499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.232492:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.232526:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305344.232596:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741526016:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 511us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305344.232604:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00010000:00010000:2.0:1788305344.232969:0:11977:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.232978:0:11977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233003:0:11977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233012:0:11977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233020:0:11977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233049:0:11977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305344.233102:0:11977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233111:0:11977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233124:0:11977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.233130:0:11977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001275cb1/0x902a3611c9ae93f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.233188:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2348:x1875173741525888:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 5616us (5786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.233197:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1788305344.237885:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.238030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741526272 00000100:00100000:2.0:1788305344.240210:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741526272 00000100:00100000:2.0:1788305344.240350:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:2.0:1788305344.240366:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11625:x1875173741526272:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788305344.240495:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240518:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240558:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240799:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240810:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240818:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240868:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.240883:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 20 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.240898:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761432832:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305344.240998:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305344.244458:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761432832:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305344.244492:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305344.247445:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.247597:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741526400 00000100:00100000:3.0:1788305344.247607:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741526400 00010000:00010000:3.0:1788305344.247645:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305344.247767:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:3.0:1788305344.247777:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:2347:x1875173741526400:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305344.247794:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305344.247802:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.247815:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.247850:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae93c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a79b expref: 21 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.247889:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:3.0:1788305344.247894:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.247903:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.247910:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.247989:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305344.248106:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:2347:x1875173741526400:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 329us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305344.248114:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00010000:00010000:2.0:1788305344.249399:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.249412:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305344.249666:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788305344.249927:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788305344.249970:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788305344.250532:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875173761432960:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788305344.250614:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305344.250713:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305344.250833:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761432960 00000100:00100000:0.0:1788305344.250841:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761432960 00000100:00100000:0.0:1788305344.250931:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305344.250943:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba0598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875173761432960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788305344.251075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba0598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875173761432960:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305344.251083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305344.251172:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788305344.251179:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fa83230700, transno 4294967319 00000004:00080000:1.0:1788305344.251194:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fa83230000, transno 4294967322 00000100:00100000:1.0:1788305344.251200:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875173761432960:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788305344.251853:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788305344.251942:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875173761433088:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788305344.251991:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305344.252925:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa82443a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305344.253015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761433088 00000100:00100000:2.0:1788305344.253023:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761433088 00000100:00100000:2.0:1788305344.253273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305344.253285:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875173761433088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788305344.253638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875173761433088:12345-0@lo:1000:mdt00_001.0 Request processed in 354us (1645us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788305344.253647:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305344.253848:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875173761433088:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788305344.253897:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.253907:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.253915:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.253937:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305344.253942:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.253950:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.253972:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88c00) 00010000:00010000:1.0:1788305344.253976:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305344.253981:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.253987:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9401 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254023:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254030:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254037:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254216:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305344.254219:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254226:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254245:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305344.254247:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305344.254254:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 23 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254266:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 23 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254274:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 23 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.254310:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 23 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305344.254326:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761433216:192.168.201.38@tcp:105: 00000100:00100000:1.0:1788305344.254455:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa82443a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305344.259845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.260279:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1319880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875173761433216:192.168.201.38@tcp:105: 00010000:00010000:2.0:1788305344.260313:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260324:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9344 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260363:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260382:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260397:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260434:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260441:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260449:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260456:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305344.260461:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260470:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260483:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305344.260487:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305344.260491:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260497:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae9408 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260507:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260512:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260517:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260528:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044c00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305344.260531:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260536:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260545:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305344.260547:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305344.260550:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.260556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae93fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.261012:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11625:x1875173741526272:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 20642us (23133us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788305344.261024:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 230 00000020:00080000:2.0:1788305344.261032:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788305344.261196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741526528 00000100:00100000:3.0:1788305344.261207:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741526528 00000100:00100000:3.0:1788305344.261270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:3.0:1788305344.261281:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11623:x1875173741526528:12345-192.168.201.38@tcp:49:lfs.0 00000100:00100000:3.0:1788305344.261402:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11623:x1875173741526528:12345-192.168.201.38@tcp:49:lfs.0 Request processed in 123us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305344.261409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1788305344.264442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.264522:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741526784 00000100:00100000:3.0:1788305344.264532:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741526784 00000100:00100000:3.0:1788305344.264583:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:3.0:1788305344.264593:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:11625:x1875173741526784:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788305344.265349:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788305344.265468:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1788305344.265514:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.265531:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.265544:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.265552:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.265560:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.265566:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.265585:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788305344.265682:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11625:x1875173741526784:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1089us (1248us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788305344.265689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000020:00080000:3.0:1788305344.265695:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788305344.265913:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305344.265921:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.265929:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305344.265933:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.265942:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.265957:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96fb87f88d00) 00010000:00010000:0.0:1788305344.265960:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305344.265976:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.265982:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbd600/0x902a3611c9ae940f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305344.266001:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305344.266003:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305344.266004:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305344.269660:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.269783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741527040 00000100:00100000:2.0:1788305344.269793:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741527040 00000100:00100000:2.0:1788305344.269860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 231 00000100:00100000:2.0:1788305344.269870:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11623:x1875173741527040:12345-192.168.201.38@tcp:58:lfs.0 00000040:00080000:2.0:1788305344.270158:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788305344.270237:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11623:x1875173741527040:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 369us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.270245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 231 00000040:00080000:1.0:1788305344.273434:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305344.273444:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305344.273509:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788305344.273519:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305344.273664:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9f6ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761433344:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305344.273779:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa82443a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305344.280195:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9f6ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875173761433344:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305344.298768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305344.298867:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741527168 00000100:00100000:1.0:1788305344.298879:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741527168 00000100:00100000:1.0:1788305344.298960:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 232 00000100:00100000:1.0:1788305344.298971:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11626:x1875173741527168:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788305344.299009:0:8201:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788305344.299183:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11626:x1875173741527168:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 212us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305344.299191:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 232 00000100:00100000:0.0:1788305344.307278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.307375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741527424 00000100:00100000:2.0:1788305344.307398:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741527424 00000100:00100000:2.0:1788305344.307456:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 233 00000100:00100000:2.0:1788305344.307466:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+25:11626:x1875173741527424:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305344.307486:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305344.307507:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9416 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.307608:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae941d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.307623:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae941d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.307636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae941d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305344.307648:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788305344.307792:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9416 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b7 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.307813:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae941d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b7 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.307822:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305344.307833:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788305344.307837:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044800, rc 0) 00000100:00100000:2.0:1788305344.307899:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+27:11626:x1875173741527424:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 434us (633us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788305344.307906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 233 00000100:00100000:0.0:1788305344.318688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305344.318805:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741527680 00000100:00100000:1.0:1788305344.318819:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741527680 00000100:00100000:1.0:1788305344.318893:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:1.0:1788305344.318903:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+27:11626:x1875173741527680:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788305344.318983:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319001:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319013:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319436:0:8201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319444:0:8201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319451:0:8201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319456:0:8201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fa00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305344.319460:0:8201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319483:0:8201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319496:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305344.319499:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305344.319504:0:8201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305344.319510:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fa00/0x902a3611c9ae942b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305344.319661:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+28:11626:x1875173741527680:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 758us (998us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788305344.319670:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 234 00000040:00080000:3.0:1788305344.320047:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305344.320081:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305344.320569:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788305344.320579:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305344.323501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.323649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741527808 00000100:00100000:2.0:1788305344.323660:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741527808 00000100:00100000:2.0:1788305344.323727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 235 00000100:00100000:2.0:1788305344.323736:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+28:11628:x1875173741527808:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305344.323760:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305344.323780:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9432 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7be expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.323877:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.323890:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.323900:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.323912:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.323918:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.323924:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.324253:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.324264:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.324283:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.324315:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.324329:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 29 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.324344:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761433472:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305344.324436:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb933e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305344.324487:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.324603:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528064 00000100:00100000:2.0:1788305344.324608:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528064 00000100:00100000:2.0:1788305344.324639:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:2.0:1788305344.324648:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+30:11626:x1875173741528064:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788305344.324835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+31:11626:x1875173741528064:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 178us (337us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788305344.324845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:2.0:1788305344.328027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305344.328188:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fba059a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875173761433472:192.168.201.38@tcp:104: 00010000:00010000:3.0:1788305344.328260:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305344.328350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528320 00000100:00100000:1.0:1788305344.328357:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528320 00000100:00100000:1.0:1788305344.328406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:1.0:1788305344.328417:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+31:5588:x1875173741528320:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788305344.328657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+32:5588:x1875173741528320:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 241us (640us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788305344.328666:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1788305344.331876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305344.332021:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528448 00000100:00100000:2.0:1788305344.332030:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528448 00010000:00010000:2.0:1788305344.332232:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 32 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305344.332304:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:2.0:1788305344.332330:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+32:2347:x1875173741528448:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305344.332346:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305344.332355:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 32 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.332370:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 32 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.332395:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9336 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a778 expref: 32 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.332414:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:2.0:1788305344.332419:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.332429:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.332436:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305344.332471:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305344.332526:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+31:2347:x1875173741528448:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 198us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305344.332535:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00010000:00010000:3.0:1788305344.333022:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333034:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305344.333124:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788305344.333130:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788305344.333152:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333166:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333175:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333181:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333187:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333193:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305344.333198:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333205:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333230:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305344.333233:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305344.333238:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333244:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045200/0x902a3611c9ae9439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333261:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333267:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333272:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333276:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305344.333279:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333286:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333293:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96fb88992300) 00010000:00010000:3.0:1788305344.333295:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305344.333298:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333302:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045800/0x902a3611c9ae9440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333353:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044c00/0x902a3611c9ae9432 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7be expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333367:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7be expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305344.333376:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305344.333378:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305344.333380:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045400, rc 0) 00000100:00100000:3.0:1788305344.333422:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+30:11628:x1875173741527808:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 9687us (10384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305344.333429:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 235 00010000:00010000:0.0:1788305344.370903:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305345.085442:0:12617:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305345.085457:0:12617:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305345.085510:0:12617:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788305345.085520:0:12617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305345.178282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305345.178386:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305345.178437:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305345.178462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305345.178486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305345.178521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529088 00000100:00100000:1.0:1788305345.178542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529088 00000100:00100000:1.0:1788305345.178599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528704 00000100:00100000:1.0:1788305345.178602:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528704 00000100:00100000:1.0:1788305345.178622:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:1.0:1788305345.178631:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741529088:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305345.178710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741529088:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305345.178718:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:1.0:1788305345.178737:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:1.0:1788305345.178743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:2347:x1875173741528704:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305345.178774:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:2347:x1875173741528704:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305345.178781:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00080000:1.0:1788305345.178801:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305345.181155:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528832 00000100:00100000:0.0:1788305345.181175:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528832 00000100:00100000:0.0:1788305345.181236:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528960 00000100:00100000:0.0:1788305345.181239:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528960 00000100:00100000:0.0:1788305345.181270:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:0.0:1788305345.181289:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741528832:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305345.181380:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741528832:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 100us (2993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.181389:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:0.0:1788305345.181408:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:0.0:1788305345.181426:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741528960:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305345.181450:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741528960:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 37us (2963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.181466:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00080000:0.0:1788305345.181496:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305345.181501:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305345.183489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741528576 00000100:00100000:3.0:1788305345.183503:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741528576 00000100:00100000:3.0:1788305345.183550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:3.0:1788305345.183560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741528576:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305345.183623:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741528576:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 65us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305345.183631:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:0.0:1788305345.268239:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761433600:0@lo:400:kworker.0 00000100:00100000:0.0:1788305345.268337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305345.268443:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761433600 00000100:00100000:0.0:1788305345.268451:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761433600 00000100:00100000:0.0:1788305345.268511:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788305345.268520:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761433600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305345.268588:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761433600:12345-0@lo:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.268595:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788305345.268645:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761433600:0@lo:400:kworker.0 00000100:00100000:3.0:1788305345.280113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305345.280139:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529344 00000100:00100000:1.0:1788305345.280151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529344 00000100:00100000:1.0:1788305345.280224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 236 00000100:00100000:1.0:1788305345.280236:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+30:11651:x1875173741529344:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305345.280278:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305345.280304:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae944e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7c5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305345.280418:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305345.280434:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305345.280460:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305345.280474:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788305345.280655:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae944e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7c5 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305345.280685:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7c5 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305345.280695:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:1.0:1788305345.280699:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788305345.280702:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305345.280770:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11651:x1875173741529344:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 536us (664us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788305345.280778:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 236 00000100:00100000:2.0:1788305345.281169:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761433984:0@lo:400:kworker.0 00000100:00100000:1.0:1788305345.281195:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761433728:0@lo:400:kworker.0 00000100:00100000:2.0:1788305345.281232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305345.281243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305345.281272:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305345.281285:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761434240:0@lo:400:kworker.0 00000100:00100000:2.0:1788305345.281288:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761434112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305345.281323:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305345.281330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305345.281352:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305345.281360:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761433856:0@lo:400:kworker.0 00000100:00100000:2.0:1788305345.281370:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761433728 00000100:00100000:2.0:1788305345.281379:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761433728 00000100:00100000:1.0:1788305345.281391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305345.281428:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434112 00000100:00100000:1.0:1788305345.281433:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434112 00000100:00100000:2.0:1788305345.281439:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761433856 00000100:00100000:2.0:1788305345.281444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761433856 00000100:00100000:2.0:1788305345.281473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788305345.281482:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761433728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305345.281536:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761433728:12345-0@lo:400:kworker.0 Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.286142:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761433984 00000100:00100000:0.0:1788305345.286158:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761433984 00000100:00100000:0.0:1788305345.286225:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434240 00000100:00100000:0.0:1788305345.286228:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434240 00000100:00100000:0.0:1788305345.286260:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788305345.286270:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761433984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305345.286371:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761433984:12345-0@lo:400:kworker.0 Request processed in 103us (5139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.286379:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788305345.286398:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788305345.286405:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761434240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305345.286448:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761434240:12345-0@lo:400:kworker.0 Request processed in 44us (5127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.286463:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1788305345.286487:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305345.286491:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305345.286493:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305345.286540:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761433984:0@lo:400:kworker.0 00000100:00100000:1.0:1788305345.286717:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788305345.286743:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788305345.286748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761433856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305345.286768:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788305345.286778:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305345.286796:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761433856:12345-0@lo:400:kworker.0 Request processed in 63us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305345.286803:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788305345.286841:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761434112:12345-0@lo:400:kworker.0 Request processed in 64us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305345.286849:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788305345.286864:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761433856:0@lo:400:kworker.0 00000100:00100000:1.0:1788305345.286879:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761433728:0@lo:400:kworker.0 00000100:00100000:1.0:1788305345.286891:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761434240:0@lo:400:kworker.0 00000100:00100000:0.0:1788305345.289734:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761434112:0@lo:400:kworker.0 00000100:00100000:3.0:1788305345.290020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305345.290697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529472 00000100:00100000:0.0:1788305345.290707:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529472 00000100:00100000:0.0:1788305345.290776:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:0.0:1788305345.290790:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11651:x1875173741529472:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1788305345.290887:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.290906:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.290919:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.290944:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.290952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.294019:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.294038:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305345.294066:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.294079:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.294102:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:0.0:1788305345.294106:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305345.294111:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.294117:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305345.294891:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+32:11651:x1875173741529472:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 4095us (4865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.294905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:1.0:1788305345.386930:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305345.387293:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529600 00000100:00100000:0.0:1788305345.387304:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529600 00000100:00100000:0.0:1788305345.387378:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:0.0:1788305345.387387:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741529600:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1788305345.387404:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305345.387431:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083befb49/0x902a3611c9ae946a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7cc expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305345.387464:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a975fbe, atime: 0x6a975fbd, ctime: 0x6a975fbe, blocks: 0xb 00010000:00010000:0.0:1788305345.387490:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788305345.387494:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305345.387503:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083befb49/0x902a3611c9ae946a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7cc expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.387535:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083befb49/0x902a3611c9ae946a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7cc expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305345.387546:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be200, rc 0) 00000100:00100000:0.0:1788305345.387610:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2349:x1875173741529600:12345-192.168.201.38@tcp:101:cat.0 Request processed in 225us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305345.387615:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1788305345.392370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305345.392443:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529728 00000100:00100000:0.0:1788305345.392456:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529728 00002000:00100000:0.0:1788305345.392525:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff96fbc16af800 x1875173741529728/t0(0) o3->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:276/0 lens 488/0 e 0 to 0 dl 1788305356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305345.392538:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc16af800 with x1875173741529728 ext(0->4095) 00002000:00010000:0.0:1788305345.392544:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbc16af800 00000100:00100000:0.0:1788305345.392803:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788305345.392826:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741529728:12345-192.168.201.38@tcp:3:cat.0 00000100:00100000:0.0:1788305345.393038:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+8:2348:x1875173741529728:12345-192.168.201.38@tcp:3:cat.0 Request processed in 215us (676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788305345.393046:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00002000:00100000:0.0:1788305345.393100:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff96fbc16af800 x1875173741529728/t0(0) o3->5455d24f-893c-4899-b5f9-16679e9a93aa@192.168.201.38@tcp:276/0 lens 488/4536 e 0 to 0 dl 1788305356 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305345.393109:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96fbc16af800 with x1875173741529728 ext(0->4095) 00002000:00010000:0.0:1788305345.393112:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96fbc16af800 00010000:00010000:1.0:1788305345.394554:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305345.777507:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305345.777511:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305345.777533:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761434368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305345.777533:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761434496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305345.783772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305345.784477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305345.788163:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434496 00000100:00100000:3.0:1788305345.788176:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434368 00000100:00100000:3.0:1788305345.788180:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434368 00000100:00100000:1.0:1788305345.788180:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434496 00000100:00100000:1.0:1788305345.788278:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305345.788284:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788305345.788289:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761434368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305345.788289:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761434496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305345.788328:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1788305345.788329:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788305345.794115:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761434368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5799us (9614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305345.794133:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305345.796603:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761434496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8306us (12828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305345.796620:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305345.796779:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761434496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305345.803032:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761434368:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788305346.354267:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305346.354280:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305346.354314:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788305346.354322:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788305346.417737:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788305347.380277:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1788305347.441331:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305348.466409:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788305349.478401:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788305349.478419:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788305349.489508:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788305349.489534:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96fa82443f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788305349.489539:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb872e3900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96fa82443c00 00000020:00080000:3.0:1788305349.489543:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96fb872e3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96fbb9968c00 00010000:00010000:3.0:1788305349.492857:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788305349.493802:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788305349.494040:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788305350.281837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305350.281889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305350.281926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305350.281961:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305350.281984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305350.282019:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741530112 00000100:00100000:3.0:1788305350.282028:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741530112 00000100:00100000:3.0:1788305350.282115:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741530240 00000100:00100000:3.0:1788305350.282119:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741530240 00000100:00100000:3.0:1788305350.282141:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:3.0:1788305350.282150:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741530112:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305350.282242:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741530112:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 93us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305350.282270:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:3.0:1788305350.282290:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:3.0:1788305350.282296:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741530240:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305350.282578:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741530368 00000100:00100000:0.0:1788305350.282583:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741530368 00000100:00100000:0.0:1788305350.282616:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529984 00000100:00100000:0.0:1788305350.282620:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529984 00000100:00100000:0.0:1788305350.282646:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:0.0:1788305350.282653:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba059a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741530368:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305350.282686:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba059a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:2347:x1875173741530368:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.282692:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:0.0:1788305350.282705:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:0.0:1788305350.282711:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2347:x1875173741529984:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305350.282750:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2347:x1875173741529984:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.282767:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00080000:0.0:1788305350.282784:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305350.282789:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305350.282791:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305350.283033:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741530240:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 734us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305350.283040:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1788305350.283138:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741529856 00000100:00100000:1.0:1788305350.283144:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741529856 00000100:00100000:1.0:1788305350.283181:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 301 00000100:00100000:1.0:1788305350.283189:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741529856:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305350.283215:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741529856:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305350.283230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 301 00000100:00100000:1.0:1788305350.386356:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761435008:0@lo:400:kworker.0 00000100:00100000:1.0:1788305350.386431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305350.386494:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305350.386501:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761434624:0@lo:400:kworker.0 00000100:00100000:1.0:1788305350.386530:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305350.386551:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761435136:0@lo:400:kworker.0 00000100:00100000:1.0:1788305350.386574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305350.386610:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761434880:0@lo:400:kworker.0 00000100:00100000:1.0:1788305350.386634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305350.386651:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305350.386656:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761434752:0@lo:400:kworker.0 00000100:00100000:1.0:1788305350.386677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305350.386692:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761435264:0@lo:400:kworker.0 00000100:00100000:1.0:1788305350.386712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305350.386897:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434624 00000100:00100000:0.0:1788305350.386905:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434624 00000100:00100000:0.0:1788305350.386969:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788305350.386978:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761434624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387034:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88feb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761434624:12345-0@lo:400:kworker.0 Request processed in 57us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.387041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788305350.387092:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435008 00000100:00100000:0.0:1788305350.387096:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435008 00000100:00100000:0.0:1788305350.387130:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435264 00000100:00100000:0.0:1788305350.387133:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435264 00000100:00100000:0.0:1788305350.387153:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305350.387159:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761435008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387190:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761435008:12345-0@lo:400:kworker.0 Request processed in 32us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.387196:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305350.387208:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305350.387215:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761435264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387247:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761435264:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.387252:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305350.387268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435136 00000100:00100000:0.0:1788305350.387271:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435136 00000100:00100000:0.0:1788305350.387292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434880 00000100:00100000:0.0:1788305350.387294:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434880 00000100:00100000:0.0:1788305350.387303:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761434752 00000100:00100000:0.0:1788305350.387306:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761434752 00000100:00100000:0.0:1788305350.387316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788305350.387323:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761435136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387353:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761435136:12345-0@lo:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.387366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788305350.387378:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788305350.387383:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761434880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387410:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761434880:12345-0@lo:400:kworker.0 Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.387415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788305350.387425:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788305350.387431:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761434752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387454:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761434752:12345-0@lo:400:kworker.0 Request processed in 23us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.387459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788305350.387475:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305350.387479:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305350.387480:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305350.387510:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761434752:0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387518:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788305350.387523:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fa81d0d500, transno 4294967310 00000100:00100000:0.0:1788305350.387531:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761435264:0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387539:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761434880:0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387573:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761434624:0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.387582:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761435136:0@lo:400:kworker.0 00000100:00100000:0.0:1788305350.388909:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788305350.388915:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788305350.388954:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc1a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761435008:0@lo:400:kworker.0 00010000:00010000:0.0:1788305350.513232:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305350.898338:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761435392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305350.898462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305350.898594:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435392 00000100:00100000:0.0:1788305350.898603:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435392 00000100:00100000:0.0:1788305350.898663:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788305350.898673:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761435392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305350.898735:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305350.898785:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761435392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.898793:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788305350.898855:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761435392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305350.901079:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761435520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305350.901160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305350.901260:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435520 00000100:00100000:0.0:1788305350.901270:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435520 00000100:00100000:0.0:1788305350.901329:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305350.901339:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761435520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305350.901386:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305350.901440:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761435520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305350.901449:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305350.901505:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761435520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788305351.538338:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305351.848783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305351.848900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741530496 00000100:00100000:0.0:1788305351.848933:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741530496 00000100:00100000:0.0:1788305351.849003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:0.0:1788305351.849015:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11303:x1875173741530496:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788305351.849158:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11303:x1875173741530496:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305351.849167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:0.0:1788305351.863042:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305351.863174:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741530752 00000100:00100000:3.0:1788305351.863188:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741530752 00000100:00100000:3.0:1788305351.863251:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788305351.863266:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+19:11303:x1875173741530752:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788305351.863906:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+20:11303:x1875173741530752:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 639us (871us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788305351.863915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1788305352.316209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305352.316466:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741530880 00000100:00100000:0.0:1788305352.316477:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741530880 00000100:00100000:0.0:1788305352.316572:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:0.0:1788305352.316586:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+5:12104:x1875173741530880:12345-192.168.201.38@tcp:101:lsof.0 00010000:00010000:0.0:1788305352.316864:0:8201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305352.316891:0:8201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7d3 expref: -99 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305352.316971:0:8201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305352.316988:0:8201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305352.317002:0:8201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305352.317412:0:8201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788305352.317416:0:8201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305352.317504:0:8201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305352.317534:0:8201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7d3 expref: 7 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305352.317774:0:8201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7d3 expref: 6 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788305352.318306:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305352.318413:0:8201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:0.0:1788305352.318417:0:8201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305352.318421:0:8201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfc00, rc 0) 00000100:00100000:0.0:1788305352.318500:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:12104:x1875173741530880:12345-192.168.201.38@tcp:101:lsof.0 Request processed in 1917us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305352.318508:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 239 00010000:00010000:0.0:1788305352.561293:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305353.588428:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788305354.595294:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788305354.595329:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788305354.596189:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788305354.596605:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788305354.609360:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305355.419186:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305355.419244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305355.419283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305355.419311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305355.419343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305355.419372:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531392 00000100:00100000:0.0:1788305355.419382:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531392 00000100:00100000:0.0:1788305355.419437:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531264 00000100:00100000:0.0:1788305355.419440:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531264 00000100:00100000:0.0:1788305355.419461:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:0.0:1788305355.419474:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741531392:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305355.419543:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2349:x1875173741531392:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305355.419550:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:0.0:1788305355.419566:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:0.0:1788305355.419588:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741531264:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305355.419616:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2349:x1875173741531264:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305355.419622:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:3.0:1788305355.420105:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531008 00000100:00100000:3.0:1788305355.420113:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531008 00000100:00100000:3.0:1788305355.420158:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 303 00000100:00100000:3.0:1788305355.420166:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741531008:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305355.420212:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2349:x1875173741531008:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 47us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305355.420229:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 303 00000100:00100000:2.0:1788305355.420469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531136 00000100:00100000:2.0:1788305355.420475:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531136 00000100:00100000:2.0:1788305355.420517:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531520 00000100:00100000:2.0:1788305355.420520:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531520 00000100:00100000:2.0:1788305355.420556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:2.0:1788305355.420565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2349:x1875173741531136:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305355.420617:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2349:x1875173741531136:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 54us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305355.420624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:2.0:1788305355.420650:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:2.0:1788305355.420665:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2349:x1875173741531520:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305355.420688:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2349:x1875173741531520:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305355.420694:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00080000:2.0:1788305355.420715:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305355.420719:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305355.420722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305355.505500:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761435776:0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.505566:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305355.505617:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761436288:0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.505648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305355.505678:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305355.505684:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761435904:0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.505703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305355.505728:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436288 00000100:00100000:3.0:1788305355.505735:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436288 00000100:00100000:3.0:1788305355.505779:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788305355.505787:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761436288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.505829:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761436288:12345-0@lo:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305355.505836:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788305355.505992:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761436032:0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305355.506042:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788305355.506047:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761435648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305355.506125:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305355.506184:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435648 00000100:00100000:1.0:1788305355.506188:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435648 00000100:00100000:1.0:1788305355.506214:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788305355.506220:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761435648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506249:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3301:x1875173761435648:12345-0@lo:400:kworker.0 Request processed in 30us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305355.506256:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788305355.506283:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435776 00000100:00100000:1.0:1788305355.506286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435776 00000100:00100000:1.0:1788305355.506308:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761435904 00000100:00100000:1.0:1788305355.506310:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761435904 00000100:00100000:1.0:1788305355.506321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436160 00000100:00100000:1.0:1788305355.506323:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436160 00000100:00100000:1.0:1788305355.506339:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788305355.506344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761435776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506369:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761435776:12345-0@lo:400:kworker.0 Request processed in 25us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305355.506375:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788305355.506384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788305355.506388:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761435904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506408:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761435904:12345-0@lo:400:kworker.0 Request processed in 20us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305355.506413:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788305355.506421:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788305355.506426:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761436160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506446:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761436160:12345-0@lo:400:kworker.0 Request processed in 20us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305355.506460:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788305355.506478:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436032 00000100:00100000:1.0:1788305355.506492:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436032 00000100:00100000:1.0:1788305355.506514:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305355.506519:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761436032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506545:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761436032:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305355.506550:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305355.506581:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761435648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506592:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305355.506599:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761436032:0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.506909:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761435904:0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.506920:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761435776:0@lo:400:kworker.0 00000100:00100000:3.0:1788305355.506929:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761436288:0@lo:400:kworker.0 00000100:00080000:2.0:1788305355.507080:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305355.507084:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305355.507087:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788305355.633455:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305356.024771:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761436416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305356.024848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305356.033093:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436416 00000100:00100000:0.0:1788305356.033108:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436416 00000100:00100000:0.0:1788305356.033191:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305356.033203:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761436416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305356.033244:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305356.033325:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761436416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (8476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305356.033331:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305356.033865:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761436416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305356.037837:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305356.037865:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761436544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305356.037948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305356.038042:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436544 00000100:00100000:0.0:1788305356.038431:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436544 00000100:00100000:0.0:1788305356.038652:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788305356.038663:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761436544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305356.038701:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305356.038841:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761436544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305356.038849:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305356.038877:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761436544:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788305356.343857:0:12824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:29:14 (1788305354) 00000040:00080000:1.0:1788305356.593318:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305356.593328:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305356.594262:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788305356.594272:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788305356.657787:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305357.682612:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305358.742126:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305359.795018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305360.524632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305360.524679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305360.524723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305360.524749:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305360.524864:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531776 00000100:00100000:1.0:1788305360.524875:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531776 00000100:00100000:1.0:1788305360.524953:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:1.0:1788305360.524967:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2347:x1875173741531776:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305360.525090:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+19:2347:x1875173741531776:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305360.525098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:1.0:1788305360.525148:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741532032 00000100:00100000:1.0:1788305360.525151:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741532032 00000100:00100000:1.0:1788305360.525177:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531904 00000100:00100000:1.0:1788305360.525180:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531904 00000100:00100000:1.0:1788305360.525201:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:1.0:1788305360.525207:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741532032:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305360.525385:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2347:x1875173741532032:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 177us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305360.525392:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:1.0:1788305360.525404:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:1.0:1788305360.525412:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741531904:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305360.525438:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2347:x1875173741531904:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305360.525444:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00080000:2.0:1788305360.525573:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305360.525578:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305360.525581:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305360.525684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305360.525753:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741532160 00000100:00100000:2.0:1788305360.525757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741532160 00000100:00100000:2.0:1788305360.525817:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:2.0:1788305360.525824:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2347:x1875173741532160:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305360.525854:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2347:x1875173741532160:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 30us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305360.525860:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:3.0:1788305360.526084:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741531648 00000100:00100000:3.0:1788305360.526089:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741531648 00000100:00100000:3.0:1788305360.526117:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 305 00000100:00100000:3.0:1788305360.526124:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741531648:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305360.526156:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741531648:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305360.526164:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 305 00000100:00080000:0.0:1788305360.526247:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305360.626370:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761436928:0@lo:400:kworker.0 00000100:00100000:2.0:1788305360.626461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305360.626534:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788305360.626541:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761436800:0@lo:400:kworker.0 00000100:00100000:2.0:1788305360.626579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305360.626598:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761437312:0@lo:400:kworker.0 00000100:00100000:2.0:1788305360.626624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305360.626663:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436928 00000100:00100000:2.0:1788305360.626672:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436928 00000100:00100000:2.0:1788305360.626723:0:8201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436800 00000100:00100000:2.0:1788305360.626726:0:8201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436800 00000100:00100000:2.0:1788305360.626747:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788305360.626755:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761436928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305360.626805:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761436928:12345-0@lo:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305360.626813:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788305360.626834:0:8201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788305360.626840:0:8201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761436800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305360.626868:0:8201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761436800:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305360.626873:0:8201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788305360.627101:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437312 00000100:00100000:1.0:1788305360.627106:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437312 00000100:00100000:1.0:1788305360.627147:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305360.627154:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761437312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305360.627188:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761437312:12345-0@lo:400:kworker.0 Request processed in 34us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305360.627193:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305360.627254:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761436800:0@lo:400:kworker.0 00000100:00100000:1.0:1788305360.627264:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761437312:0@lo:400:kworker.0 00000100:00100000:1.0:1788305360.627272:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761436928:0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627374:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb85164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761436672:0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627418:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305360.627454:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761437184:0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627477:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305360.627496:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305360.627502:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761437056:0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788305360.627556:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305360.627561:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305360.627572:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437184 00000100:00100000:0.0:1788305360.627576:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437184 00000100:00100000:0.0:1788305360.627605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788305360.627612:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761437184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627648:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761437184:12345-0@lo:400:kworker.0 Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305360.627655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788305360.627668:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305360.627684:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761437184:0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627710:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437056 00000100:00100000:0.0:1788305360.627713:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437056 00000100:00100000:0.0:1788305360.627742:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788305360.627748:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761437056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305360.627782:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761437056:12345-0@lo:400:kworker.0 Request processed in 34us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305360.627788:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788305360.627800:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305360.627826:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761437056:0@lo:400:kworker.0 00000100:00100000:1.0:1788305360.628104:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761436672 00000100:00100000:1.0:1788305360.628115:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761436672 00000100:00100000:1.0:1788305360.628153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788305360.628161:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761436672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305360.628198:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761436672:12345-0@lo:400:kworker.0 Request processed in 38us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305360.628205:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788305360.628358:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb85164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761436672:0@lo:400:kworker.0 00010000:00010000:0.0:1788305360.817475:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305361.137505:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305361.137601:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305361.137621:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761437568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305361.137700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305361.137789:0:10122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437568 00000100:00100000:1.0:1788305361.137797:0:10122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437568 00000100:00100000:1.0:1788305361.137846:0:10122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305361.137856:0:10122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761437568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305361.137894:0:10122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305361.137941:0:10122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761437568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305361.137948:0:10122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305361.137995:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761437568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305361.152673:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761437440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305361.152781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305361.152924:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437440 00000100:00100000:0.0:1788305361.152935:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437440 00000100:00100000:0.0:1788305361.152996:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305361.153006:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761437440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305361.153081:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305361.153143:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761437440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305361.153152:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788305361.153287:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761437440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305361.512284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305361.512364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741532416 00000100:00100000:1.0:1788305361.512377:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741532416 00000100:00100000:1.0:1788305361.512445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1788305361.512455:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+19:12326:x1875173741532416:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:1.0:1788305361.513145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:12326:x1875173741532416:12345-192.168.201.38@tcp:35:umount.0 Request processed in 690us (871us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788305361.513164:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1788305361.517748:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305361.517993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741532672 00000100:00100000:2.0:1788305361.518008:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741532672 00000100:00100000:2.0:1788305361.518133:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:2.0:1788305361.518147:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+20:12326:x1875173741532672:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:2.0:1788305361.519083:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+21:12326:x1875173741532672:12345-192.168.201.38@tcp:35:umount.0 Request processed in 906us (1316us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788305361.519095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:0.0:1788305361.529015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305361.529106:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741532928 00000100:00100000:3.0:1788305361.529116:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741532928 00000100:00100000:3.0:1788305361.529174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:3.0:1788305361.529185:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fba02ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+21:12326:x1875173741532928:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:3.0:1788305361.530150:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fba02ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5455d24f-893c-4899-b5f9-16679e9a93aa+22:12326:x1875173741532928:12345-192.168.201.38@tcp:35:umount.0 Request processed in 962us (1140us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788305361.530159:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1788305361.536952:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305361.537047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741533184 00000100:00100000:2.0:1788305361.537097:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741533184 00000100:00100000:2.0:1788305361.537153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:2.0:1788305361.537164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+22:12326:x1875173741533184:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:2.0:1788305361.537905:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbbb417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+23:12326:x1875173741533184:12345-192.168.201.38@tcp:35:umount.0 Request processed in 739us (970us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788305361.537914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1788305361.552523:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305361.552573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305361.552611:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305361.552686:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741533312 00000100:00100000:2.0:1788305361.552698:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741533312 00000100:00100000:2.0:1788305361.552773:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741533568 00000100:00100000:2.0:1788305361.552777:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741533568 00000100:00100000:2.0:1788305361.552791:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741533440 00000100:00100000:2.0:1788305361.552793:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741533440 00000100:00100000:2.0:1788305361.552809:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788305361.552818:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb873e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+15:2347:x1875173741533312:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305361.552834:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305361.552854:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7de00/0x902a3611c9ae84f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a35e expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305361.552889:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305361.552942:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb873e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+14:2347:x1875173741533312:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 124us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305361.552949:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788305361.553002:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1788305361.553009:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+13:2347:x1875173741533568:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305361.553018:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305361.553029:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae86da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a429 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305361.553039:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305361.553085:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:2347:x1875173741533568:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 76us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305361.553092:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1788305361.553105:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1788305361.553111:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2347:x1875173741533440:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305361.553120:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305361.553129:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7d600/0x902a3611c9ae8456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a326 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305361.553138:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305361.553156:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2347:x1875173741533440:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 46us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305361.553163:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1788305361.558984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305361.559100:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741533696 00000100:00100000:1.0:1788305361.559111:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741533696 00000100:00100000:1.0:1788305361.559169:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:1.0:1788305361.559179:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb85164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+5:2346:x1875173741533696:12345-192.168.201.38@tcp:9:umount.0 00000020:00000080:1.0:1788305361.559225:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae87c8 00000100:00080000:1.0:1788305361.559233:0:6675:0:(import.c:65:import_set_state_nolock()) ffff96fb880cb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305361.559621:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788305361.560159:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305361.560474:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb85164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5455d24f-893c-4899-b5f9-16679e9a93aa+2:2346:x1875173741533696:12345-192.168.201.38@tcp:9:umount.0 Request processed in 1292us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305361.560484:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:1.0:1788305361.587024:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305361.588742:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741534080 00000100:00100000:0.0:1788305361.588769:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741534080 00000100:00100000:0.0:1788305361.588843:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:0.0:1788305361.588854:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+7:2346:x1875173741534080:12345-192.168.201.38@tcp:9:umount.0 00000020:00000080:0.0:1788305361.588889:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8a29 00000020:00010000:0.0:1788305361.588898:0:6678:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96fbc1ad2000: total 0 00000100:00080000:0.0:1788305361.588903:0:6678:0:(import.c:65:import_set_state_nolock()) ffff96fbc1ad0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305361.588959:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788305361.589891:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96fbc1ad2000: total 0 00010000:00010000:1.0:1788305361.589928:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96fbc1ad2000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788305361.589995:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083befb49/0x902a3611c9ae946a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7cc expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305361.590038:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdde6afd/0x902a3611c9ae8dcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5fe expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305361.590092:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96fbc1ad2000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788305361.590105:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305361.590119:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305361.590121:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305361.590752:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+2:2346:x1875173741534080:12345-192.168.201.38@tcp:9:umount.0 Request processed in 1893us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305361.590771:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:2.0:1788305361.597885:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305361.598128:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741535104 00000100:00100000:1.0:1788305361.598138:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741535104 00000100:00100000:1.0:1788305361.598206:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:1.0:1788305361.598217:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+23:2346:x1875173741535104:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:1.0:1788305361.598646:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8464 00000020:00010000:1.0:1788305361.598663:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96fa82772000: total 0 00000100:00080000:1.0:1788305361.598669:0:5834:0:(import.c:65:import_set_state_nolock()) ffff96fbb9e7d000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788305361.598833:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96fa82772000: total 0 00010000:00010000:3.0:1788305361.598837:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305361.598884:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96fa82772000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1788305361.598916:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96fb88992200) 00010000:00010000:3.0:1788305361.598920:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305361.598928:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae872e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a437 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.598955:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305361.598958:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788305361.598962:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae8e4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a621 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.598974:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff96fba21afc00) 00010000:00010000:3.0:1788305361.598976:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305361.598987:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044e00/0x902a3611c9ae9129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a6f3 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599008:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305361.599010:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305361.599015:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae8a8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a525 expref: 19 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599028:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305361.599030:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305361.599034:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044600/0x902a3611c9ae8cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5b1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599045:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96fb88992000) 00010000:00010000:3.0:1788305361.599047:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788305361.599082:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae879e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a453 expref: 17 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599100:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305361.599102:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305361.599106:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf200/0x902a3611c9ae934b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a77f expref: 16 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599118:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305361.599120:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305361.599124:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2045400/0x902a3611c9ae9447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7be expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599138:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:3.0:1788305361.599147:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305361.599151:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bec00/0x902a3611c9ae8e2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a61a expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599166:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb87f88600) 00010000:00010000:3.0:1788305361.599168:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305361.599171:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbcc00/0x902a3611c9ae874a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a43e expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599204:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305361.599206:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788305361.599210:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae8db7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5f7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599224:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305361.599227:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305361.599231:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044800/0x902a3611c9ae941d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7b7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.599242:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96fba21afb00) 00010000:00010000:3.0:1788305361.599244:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788305361.599256:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7c5 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788305361.599972:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788305361.601167:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5455d24f-893c-4899-b5f9-16679e9a93aa+10:2346:x1875173741535104:12345-192.168.201.38@tcp:39:umount.0 Request processed in 2946us (3286us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788305361.601179:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 240 00010000:00010000:3.0:1788305361.603578:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96fba21af900) 00010000:00010000:3.0:1788305361.603583:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305361.603595:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbc2044000/0x902a3611c9ae8d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a5e9 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305361.603639:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96fa82772000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1788305361.603681:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305361.603684:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305361.603687:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305361.841390:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305362.822377:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:1.0:1788305362.822387:0:7633:0:(genops.c:885:class_export_put()) final put ffff96fb880c8800/5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:2.0:1788305362.822465:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb880c8800/5455d24f-893c-4899-b5f9-16679e9a93aa for lustre-OST0001 00000020:00000080:2.0:1788305362.822520:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fb880cb000 for lustre-OST0001 00010000:00010000:1.0:1788305362.868217:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305363.478452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305363.478518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305363.478556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305363.480433:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741535232 00000100:00100000:1.0:1788305363.480449:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741535232 00000100:00100000:1.0:1788305363.480533:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741535360 00000100:00100000:1.0:1788305363.480536:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741535360 00000100:00100000:1.0:1788305363.480548:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741535488 00000100:00100000:1.0:1788305363.480550:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741535488 00000100:00100000:1.0:1788305363.480568:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1788305363.480577:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+12:2348:x1875173741535232:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305363.480592:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305363.480611:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fd600/0x902a3611c9ae8536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a373 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305363.480645:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305363.480698:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+11:2348:x1875173741535232:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 122us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305363.480705:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1788305363.480734:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305363.480741:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+10:2348:x1875173741535360:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305363.480749:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305363.480757:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc21fce00/0x902a3611c9ae853d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a39d expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305363.480767:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305363.480783:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+9:2348:x1875173741535360:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 43us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305363.480789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305363.480802:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1788305363.480808:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+8:2347:x1875173741535488:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305363.480816:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305363.480825:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071e200/0x902a3611c9ae86d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a422 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305363.480833:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305363.480863:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+7:2347:x1875173741535488:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 55us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305363.480868:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1788305363.504386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305363.504603:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741535744 00000100:00100000:1.0:1788305363.504627:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741535744 00000100:00100000:1.0:1788305363.504702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 241 00000100:00100000:1.0:1788305363.504718:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+6:2346:x1875173741535744:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:1.0:1788305363.504761:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae854b 00000020:00010000:1.0:1788305363.504770:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96fbc0fdd000: total 0 00000100:00080000:1.0:1788305363.504779:0:5833:0:(import.c:65:import_set_state_nolock()) ffff96fbc0fdf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305363.504829:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1788305363.505343:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96fbc0fdd000: total 0 00010000:00010000:3.0:1788305363.505393:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96fbc0fdd000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788305363.505428:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fba21af700) 00010000:00010000:3.0:1788305363.505432:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305363.505441:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfc00/0x902a3611c9ae9478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7d3 expref: 5 pid: 8201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305363.505463:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96fbc0fdd000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788305363.505474:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305363.505476:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305363.505478:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305363.505574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebaa8433-1f27-44cd-ad51-1be099f60f8e+3:2346:x1875173741535744:12345-192.168.201.38@tcp:39:umount.0 Request processed in 860us (1198us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788305363.505584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 241 00000100:00080000:0.0:1788305363.505833:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305363.529707:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305363.529810:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536000 00000100:00100000:1.0:1788305363.529825:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536000 00000100:00100000:1.0:1788305363.529924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 307 00000100:00100000:1.0:1788305363.529936:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+7:2346:x1875173741536000:12345-192.168.201.38@tcp:251:umount.0 00000020:00000080:1.0:1788305363.529991:0:5828:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8441 00000020:00010000:1.0:1788305363.530003:0:5828:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96fbaf551800: total 0 00000100:00080000:1.0:1788305363.530008:0:5828:0:(import.c:65:import_set_state_nolock()) ffff96fbaf553800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788305363.530087:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96fbaf551800: total 0 00010000:00010000:3.0:1788305363.530152:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305363.530228:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96fbaf551800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788305363.530274:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae84f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a365 expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305363.530298:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96fbaf551800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788305363.530315:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305363.530317:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305363.530319:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305363.530398:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6+1:2346:x1875173741536000:12345-192.168.201.38@tcp:251:umount.0 Request processed in 458us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305363.530411:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 307 00000020:00000080:1.0:1788305363.530427:0:5828:0:(genops.c:885:class_export_put()) final put ffff96fbaf551800/e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6 00000020:00000080:3.0:1788305363.530520:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf551800/e1a348bd-a0f9-486d-bb0d-7c1c18cc6ca6 for MGS 00000020:00000080:3.0:1788305363.530579:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbaf553800 for MGS 00010000:00010000:0.0:1788305363.889462:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788305364.801503:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000001:00080000:2.0:1788305364.801523:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788305364.801530:0:5855:0:(genops.c:885:class_export_put()) final put ffff96fbc0fdd000/ebaa8433-1f27-44cd-ad51-1be099f60f8e 00000001:00100000:2.0:1788305364.801555:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000001:00080000:2.0:1788305364.801561:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788305364.801573:0:5855:0:(genops.c:885:class_export_put()) final put ffff96fa82772000/5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:1.0:1788305364.801580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc0fdd000/ebaa8433-1f27-44cd-ad51-1be099f60f8e for lustre-MDT0000 00000020:00000080:1.0:1788305364.801661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa82772000/5455d24f-893c-4899-b5f9-16679e9a93aa for lustre-MDT0000 00000020:00000080:1.0:1788305364.801720:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbc0fdf000 for lustre-MDT0000 00000020:00000080:1.0:1788305364.801726:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbb9e7d000 for lustre-MDT0000 00000001:00100000:2.0:1788305364.811895:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:2.0:1788305364.811906:0:6702:0:(genops.c:885:class_export_put()) final put ffff96fbc1ad2000/5455d24f-893c-4899-b5f9-16679e9a93aa 00000020:00000080:2.0:1788305364.817623:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc1ad2000/5455d24f-893c-4899-b5f9-16679e9a93aa for lustre-OST0000 00000020:00000080:2.0:1788305364.817677:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbc1ad0800 for lustre-OST0000 00010000:00010000:2.0:1788305364.922357:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788305365.727733:0:13027:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:0.0:1788305365.746749:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761437696:0@lo:400:kworker.0 00000100:00100000:0.0:1788305365.746826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305365.746965:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305365.746971:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761437824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305365.746971:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761438080:0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305365.747001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305365.747021:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305365.747026:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761437952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305365.747033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437696 00000100:00100000:0.0:1788305365.747039:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437696 00000100:00100000:2.0:1788305365.747045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305365.747088:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438080 00000100:00100000:2.0:1788305365.747091:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438080 00000100:00100000:0.0:1788305365.747100:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788305365.747109:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761437696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747126:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788305365.747131:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761438080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747156:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761438080:12345-0@lo:400:kworker.0 Request processed in 26us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305365.747156:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88fe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3302:x1875173761437696:12345-0@lo:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305365.747164:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305365.747164:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788305365.747189:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437824 00000100:00100000:2.0:1788305365.747192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437824 00000100:00100000:0.0:1788305365.747209:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761438080:0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747212:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761437952 00000100:00100000:2.0:1788305365.747214:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761437952 00000100:00100000:0.0:1788305365.747219:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:16674bd8-0f21-440d-92a6-ff3988850e9b:3302:1875173761437696:0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788305365.747239:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761437824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747272:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761437824:12345-0@lo:400:kworker.0 Request processed in 33us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305365.747278:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788305365.747289:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788305365.747296:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb985b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761437952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747321:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb985b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761437952:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305365.747326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1788305365.747344:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305365.747349:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305365.747366:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761437952:0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.747376:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761437824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305365.747435:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761438208:0@lo:400:kworker.0 00000100:00100000:0.0:1788305365.747471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788305365.747476:0:13027:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788305365.747528:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.747540:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.747547:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.747554:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.747570:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788305365.747575:0:13027:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788305365.747594:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788305365.747598:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788305365.747633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438208 00000100:00100000:2.0:1788305365.747636:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438208 00000100:00100000:2.0:1788305365.747662:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788305365.747668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761438208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305365.747694:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305365.747702:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761438336:0@lo:400:kworker.0 00000100:00100000:1.0:1788305365.747738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305365.747770:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438336 00000100:00100000:1.0:1788305365.747774:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438336 00000100:00100000:1.0:1788305365.747803:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788305365.747809:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761438336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305365.747841:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761438336:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.747847:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788305365.747880:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761438336:0@lo:400:kworker.0 00010000:00010000:1.0:1788305365.747910:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305365.747917:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.747925:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031000 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305365.747928:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.747937:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305365.747944:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305365.747950:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788305365.747952:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788305365.747954:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788305365.747976:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.747990:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1788305365.748002:0:13027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788305365.748002:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.748008:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae84c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305365.748014:0:13027:0:(import.c:65:import_set_state_nolock()) ffff96fb90efe000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788305365.748018:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305365.748020:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305365.748021:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305365.748030:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761438464:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788305365.748041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305365.748044:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305365.748071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305365.748091:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761438592:0@lo:39:umount.0 00000100:00100000:1.0:1788305365.748103:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438464 00000100:00100000:1.0:1788305365.748106:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438464 00000100:00100000:3.0:1788305365.748116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305365.748133:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305365.748140:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3304:x1875173761438464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305365.748150:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305365.748165:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071ec00/0x902a3611c9ae84cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae84c6 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.748178:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305365.748214:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3304:x1875173761438464:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.748221:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305365.748248:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438592 00000100:00100000:1.0:1788305365.748255:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438592 00000100:00100000:1.0:1788305365.748293:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788305365.748327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875173761438592:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788305365.748364:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8250 00000100:00080000:1.0:1788305365.748375:0:5834:0:(import.c:65:import_set_state_nolock()) ffff96fbaf13e000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788305365.748450:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3300:x1875173761438592:12345-0@lo:39:umount.0 Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.748471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788305365.748482:0:5834:0:(genops.c:885:class_export_put()) final put ffff96fbaf13a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788305365.748519:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305365.748548:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fb90efe000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788305365.748559:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761438592:0@lo:39:umount.0 00000020:00000080:1.0:1788305365.748587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf13a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788305365.748673:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbaf13e000 for lustre-MDT0000 00000100:00100000:1.0:1788305365.749608:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:16674bd8-0f21-440d-92a6-ff3988850e9b:3304:1875173761438464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305365.749784:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761438208:0@lo:400:kworker.0 00000100:00100000:2.0:1788305365.749785:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761438208:12345-0@lo:400:kworker.0 Request processed in 2116us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305365.749793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1788305365.751633:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788305365.751646:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788305365.751656:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788305365.753983:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.754011:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760695:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760717:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760748:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305365.760761:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760769:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760776:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760782:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760798:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788305365.760805:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760812:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760818:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760847:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.760856:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305365.760857:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788305365.760863:0:13027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.760864:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760869:0:13027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760876:0:13027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.760877:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031a00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305365.760881:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760882:0:13027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305365.760889:0:13027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788305365.760891:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305365.760892:0:13027:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:2.0:1788305365.760897:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305365.760902:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305365.760905:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788305365.760907:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:3.0:1788305365.760930:0:13027:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788305365.760934:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788305365.760939:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305365.760945:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00010000:00010000:2.0:1788305365.760951:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788305365.760952:0:13027:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96fbaf4f3000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788305365.760957:0:13027:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96fb90efc800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788305365.760957:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1788305365.760962:0:13027:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff96fb90fe19b8) has exports, disconnecting them 00000020:00080000:3.0:1788305365.760966:0:13027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96fbaf4f3000), last request at 1788305365 00000020:00000080:3.0:1788305365.760974:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae83c3 00010000:00010000:2.0:1788305365.760981:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.760988:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031a00/0x902a3611c9ae84d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305365.760992:0:13027:0:(import.c:65:import_set_state_nolock()) ffff96fbaf4f2000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788305365.761000:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788305365.761003:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761008:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c800 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305365.761011:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761021:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305365.761028:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305365.761033:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305365.761035:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788305365.761037:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:3.0:1788305365.761040:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96fbaf4f3000): rc 0 00000020:00000080:3.0:1788305365.761043:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbaf4f3000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788305365.761069:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788305365.761073:0:13027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96fb90efc800), last request at 1788305365 00010000:00010000:2.0:1788305365.761076:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1788305365.761077:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae82f8 00000100:00080000:3.0:1788305365.761082:0:13027:0:(import.c:65:import_set_state_nolock()) ffff96fb90ef9000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788305365.761082:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761088:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7c800/0x902a3611c9ae83fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae8402 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788305365.761089:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96fb90efc800): rc 0 00000020:00000080:3.0:1788305365.761091:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb90efc800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788305365.761097:0:13027:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb81140dabae0 00010000:00010000:2.0:1788305365.761100:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305365.761103:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761108:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031e00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305365.761111:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305365.761116:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:2.0:1788305365.761116:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305365.761119:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788305365.761131:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:00010000:2.0:1788305365.761131:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305365.761136:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788305365.761138:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788305365.761139:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788305365.761152:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761158:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305365.761172:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761179:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031e00/0x902a3611c9ae86fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae8704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761187:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305365.761190:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761196:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc21fc600 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:2.0:1788305365.761199:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761205:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305365.761208:0:13027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 10000000:00010000:2.0:1788305365.761210:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305365.761219:0:13027:0:(import.c:65:import_set_state_nolock()) ffff96fbc1365000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1788305365.761224:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305365.761226:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00080000:3.0:1788305365.761228:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 10000000:01000000:2.0:1788305365.761228:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1788305365.761230:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788305365.761236:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788305365.761239:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761245:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305365.761250:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761256:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc21fc600/0x902a3611c9ae81af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae81b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761267:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305365.761268:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305365.761270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305365.761290:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761438976:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788305365.761295:0:13027:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788305365.761302:0:13027:0:(import.c:65:import_set_state_nolock()) ffff96fbc1460800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788305365.761330:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96fb90fe19b8) has no exports 00000100:00100000:2.0:1788305365.761349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305365.761403:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305365.761409:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761439232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305365.761432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305365.761470:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438976 00000100:00100000:2.0:1788305365.761479:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438976 00000100:00100000:1.0:1788305365.761500:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb985b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761438720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305365.761524:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761439232 00000100:00100000:1.0:1788305365.761526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305365.761527:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761439232 00000100:00100000:2.0:1788305365.761539:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438720 00000100:00100000:2.0:1788305365.761542:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438720 00000100:00100000:1.0:1788305365.761543:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305365.761547:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa81d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761438848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305365.761555:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305365.761564:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb873e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+20:3303:x1875173761438976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305365.761565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305365.761584:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305365.761598:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae8704 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae86fd expref: 20 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305365.761611:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305365.761647:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb873e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761438976:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305365.761654:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305365.761661:0:8499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761438848 00000100:00100000:1.0:1788305365.761664:0:8499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761438848 00000100:00100000:1.0:1788305365.761684:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305365.761690:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16674bd8-0f21-440d-92a6-ff3988850e9b+19:3303:x1875173761439232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305365.761698:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305365.761707:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7c400/0x902a3611c9ae81b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae81af expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.761717:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305365.761745:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16674bd8-0f21-440d-92a6-ff3988850e9b+18:3303:x1875173761439232:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.761758:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305365.761773:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305365.761779:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16674bd8-0f21-440d-92a6-ff3988850e9b+17:3301:x1875173761438720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305365.761788:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305365.761796:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81490800/0x902a3611c9ae84db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae84d4 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305365.761804:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305365.761827:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16674bd8-0f21-440d-92a6-ff3988850e9b+16:3301:x1875173761438720:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.761833:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305365.761843:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305365.761849:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16674bd8-0f21-440d-92a6-ff3988850e9b+15:3301:x1875173761438848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305365.761856:0:8499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305365.761863:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030600/0x902a3611c9ae8402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae83fb expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305365.761870:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761439232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305365.761871:0:8499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305365.761879:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:16674bd8-0f21-440d-92a6-ff3988850e9b:3303:1875173761438976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305365.761889:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16674bd8-0f21-440d-92a6-ff3988850e9b+14:3301:x1875173761438848:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.761894:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1788305365.761915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf4f3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788305365.761966:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb90efc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788305365.761996:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbaf4f2000 for lustre-MDT0000 00000020:00000080:1.0:1788305365.762003:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fb90ef9000 for lustre-MDT0000 00000100:00100000:1.0:1788305365.762073:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa81d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761438848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305365.762084:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb985b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761438720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305365.762100:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305365.762109:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761439104:0@lo:9:umount.0 00000100:00100000:2.0:1788305365.762138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305365.762206:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761439360:0@lo:9:umount.0 00000100:00100000:1.0:1788305365.765558:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761439104 00000100:00100000:1.0:1788305365.765573:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761439104 00000100:00100000:1.0:1788305365.765631:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305365.765640:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875173761439104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788305365.765670:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8353 00000100:00080000:1.0:1788305365.765757:0:6677:0:(import.c:65:import_set_state_nolock()) ffff96fa81b45000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305365.765797:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788305365.769994:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3300:x1875173761439104:12345-0@lo:9:umount.0 Request processed in 4339us (7839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.770012:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788305365.770087:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305365.770179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788305365.770267:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc1365000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788305365.770289:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788305365.770292:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788305365.770296:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761439104:0@lo:9:umount.0 00000100:00100000:1.0:1788305365.770360:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761439360 00000100:00100000:1.0:1788305365.770368:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761439360 00000100:00100000:1.0:1788305365.770414:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788305365.770423:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875173761439360:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788305365.770450:0:11977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae842c 00000100:00080000:1.0:1788305365.770491:0:11977:0:(import.c:65:import_set_state_nolock()) ffff96fbaf4f7800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788305365.770525:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788305365.770526:0:11977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788305365.770963:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3300:x1875173761439360:12345-0@lo:9:umount.0 Request processed in 540us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305365.770970:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788305365.771016:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc1460800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788305365.771034:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788305365.771036:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788305365.771040:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761439360:0@lo:9:umount.0 00000020:00080000:3.0:1788305365.784795:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96fb90fe19b8) has no exports 00000020:00000080:3.0:1788305365.855996:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae820a 00000020:00000080:3.0:1788305365.856015:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbaf204800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788305365.856112:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788305365.856219:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305365.856233:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788305365.856239:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff96fb850299b8) has no exports 00000020:00000080:2.0:1788305365.859914:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8203 00000020:00000080:2.0:1788305365.859928:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbbb3f2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788305365.860024:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf204800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788305365.860436:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305365.860450:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788305365.860463:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbb8838800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788305365.860483:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbb8838800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788305365.860491:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788305365.860657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbbb3f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788305365.860772:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fbaf6847e0 - data ffff96fba5637870/ffff96fbaf48b400 00000020:01000000:2.0:1788305365.860914:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fb85004b40 - data ffff96fba56b06c0/ffff96fbbb3dec00 00000001:00000004:2.0:1788305365.878859:0:13027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00010000:00010000:2.0:1788305365.945555:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305366.010269:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305366.010276:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788305366.010305:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305366.010308:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788305366.010648:0:6927:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788305366.010659:0:6927:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788305366.010720:0:6927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788305366.013176:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305366.013186:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788305366.013264:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305366.013267:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788305366.017886:0:7939:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788305366.017893:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788305366.017909:0:7939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788305366.162995:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae81d2 00000020:00000080:1.0:1788305366.163009:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb8301f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788305366.164393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8301f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788305366.164978:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae81e7 00000020:00000080:1.0:1788305366.164987:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb8301a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788305366.165095:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788305366.165102:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.165110:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788305366.165114:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff96fb90fe4d28) has no exports 00000004:01000000:1.0:1788305366.165286:0:13027:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788305366.165294:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8425 00000020:00000080:1.0:1788305366.165299:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbb9e7d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305366.168017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8301a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788305366.171222:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788305366.171244:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.171264:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305366.171271:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff96fa818c0000) has no exports 00000020:00000080:1.0:1788305366.171286:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae841e 00000020:00000080:1.0:1788305366.171298:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbc1465800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788305366.174149:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbb9e7d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788305366.175654:0:13027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788305366.175663:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305366.177740:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788305366.177754:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305366.177758:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305366.178933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc1465800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788305366.179917:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.179939:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305366.179952:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae833e 00000020:00000080:1.0:1788305366.179962:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fa81b42800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305366.183188:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbc1460800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788305366.183208:0:8:0:(genops.c:885:class_export_put()) final put ffff96fbbd321800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305366.183212:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbbd321800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788305366.183221:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788305366.183562:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788305366.183744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa81b42800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788305366.183869:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.183882:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788305366.183887:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff96fba0524d28) has no exports 00000020:00000080:1.0:1788305366.183896:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8337 00000020:00000080:1.0:1788305366.183905:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbc1361000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788305366.184146:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc1361000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788305366.184971:0:13027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788305366.184976:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305366.184980:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788305366.184987:0:13027:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305366.184990:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305366.186364:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.186383:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305366.186418:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.186422:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305366.186428:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbb8915000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788305366.186432:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbb8915000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788305366.186447:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305366.186644:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae81ee 00000020:00000080:1.0:1788305366.186655:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb8301b000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788305366.191191:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788305366.191468:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.191578:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788305366.191585:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff96fb90fe0000) has no exports 00000020:00000080:1.0:1788305366.192088:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.192098:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788305366.192226:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae81f5 00000020:00000080:1.0:1788305366.192239:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb8301d800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788305366.192311:0:13027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fb8951b000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788305366.192315:0:13027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fb8951b000 3 00000020:01000004:1.0:1788305366.192361:0:13027:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96fb8951b000 from lustre-MDT0000 00000020:00000080:1.0:1788305366.192498:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.192504:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788305366.192523:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb83018800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788305366.192526:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb83018800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788305366.192543:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1788305366.193329:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbc1365000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788305366.193341:0:8:0:(genops.c:885:class_export_put()) final put ffff96fbbd7f3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305366.193344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbbd7f3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788305366.193351:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:1.0:1788305366.193462:0:13027:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788305366.193468:0:13027:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788305366.193472:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788305366.193476:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.193480:0:13027:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788305366.193486:0:13027:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff96fba051a800 16674bd8-0f21-440d-92a6-ff3988850e9b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305366.193492:0:13027:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff96fb90fe3370) has exports, disconnecting them 00000020:00080000:1.0:1788305366.193497:0:13027:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96fba051a800), last request at 1788305133 00000020:00000080:1.0:1788305366.193511:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8193 00000020:00010000:1.0:1788305366.193516:0:13027:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96fba051a800: total 2 00000100:00080000:1.0:1788305366.193521:0:13027:0:(import.c:65:import_set_state_nolock()) ffff96fba051c000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788305366.193546:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96fba051a800): rc 0 00000020:00080000:1.0:1788305366.193551:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff96fb90fe3370) has no exports 00000020:00000080:3.0:1788305366.193599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8301b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788305366.193607:0:8:0:(genops.c:885:class_export_put()) final put ffff96fb83019000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788305366.193609:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb83019000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788305366.193619:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:1.0:1788305366.193754:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff96fb90f14000:5828] 2 exiting: rc = 0 00000020:00000080:3.0:1788305366.193798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8301d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788305366.193854:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96fb90f15600:5826] 0 exiting: rc = 1 00000020:00010000:2.0:1788305366.193924:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96fba051a800: total 0 00010000:00010000:2.0:1788305366.193954:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96fba051a800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788305366.193983:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb81491400/0x902a3611c9ae84e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae84e2 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194015:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80030200/0x902a3611c9ae86e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae86e1 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194026:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbb9dbc000/0x902a3611c9ae86f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae86ef expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194040:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031200/0x902a3611c9ae82ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae82a4 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194082:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031600/0x902a3611c9ae8495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae848e expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194095:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071ea00/0x902a3611c9ae84a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae849c expref: 4 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194110:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031800/0x902a3611c9ae84b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae84aa expref: 3 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305366.194112:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff96fb88a44400:5827] 1 exiting: rc = 0 00010000:00010000:2.0:1788305366.194127:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7d200/0x902a3611c9ae84bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x902a3611c9ae84b8 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305366.194139:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96fba051a800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788305366.194152:0:5822:0:(genops.c:885:class_export_put()) final put ffff96fba051a800/16674bd8-0f21-440d-92a6-ff3988850e9b 00010000:00010000:2.0:1788305366.194162:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305366.194164:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305366.194166:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305366.194237:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788305366.194243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fba051a800/16674bd8-0f21-440d-92a6-ff3988850e9b for MGS 00000100:00100000:1.0:1788305366.194250:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194258:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194266:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194273:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194281:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788305366.194286:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fba051c000 for MGS 00000100:00100000:1.0:1788305366.194292:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194300:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194307:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194313:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194322:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194330:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194339:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194348:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194365:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194371:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194378:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194386:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194404:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194414:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194421:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194427:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194440:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194446:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194465:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.194471:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195344:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195357:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195363:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195371:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195378:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195385:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195391:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195398:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195408:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195416:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195426:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195431:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195440:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195846:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195859:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195865:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195870:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195876:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195882:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195887:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195893:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195899:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195904:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195920:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195926:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195931:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195938:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195945:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195952:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195967:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195975:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195982:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195990:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.195996:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.196005:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.196013:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.196021:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.196028:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788305366.199306:0:13027:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788305366.199314:0:13027:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788305366.207147:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fbaf46ed20 - data ffff96fb9fd35870/ffff96fbc0d17000 00000020:01000000:1.0:1788305366.207363:0:13027:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fb86e6fcc0 - data ffff96fba5413000/ffff96fb9c919000 00000020:00000080:1.0:1788305366.209997:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8177 00000020:00000080:1.0:1788305366.210009:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fba07eb800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788305366.210118:0:13027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fb8951b000 from MGS, refs=2 00000020:01000004:1.0:1788305366.210123:0:13027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fb8951b000 2 00000020:01000004:1.0:1788305366.210126:0:13027:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96fb8951b000 from MGS 00000020:00000080:1.0:1788305366.210157:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.210163:0:13027:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788305366.210167:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fba07ed000/MGS 00000020:00000080:1.0:1788305366.210170:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fba07ed000/MGS for MGS 00000020:01000000:1.0:1788305366.210179:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788305366.210246:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788305366.210251:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.210256:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788305366.210264:0:13027:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96fb90eff000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305366.210269:0:13027:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff96fb90f4cd28) has exports, disconnecting them 00000020:00080000:1.0:1788305366.210285:0:13027:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96fb90eff000), last request at 1788305134 00000020:00000080:1.0:1788305366.210290:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8242 00000020:00080000:1.0:1788305366.210302:0:13027:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96fb90eff000): rc 0 00000020:00000080:1.0:1788305366.210307:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb90eff000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788305366.211999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fba07eb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788305366.215886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb90eff000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788305366.216118:0:13027:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788305366.216138:0:13027:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305366.216143:0:13027:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788305366.216149:0:13027:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305366.216230:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fb90efe000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788305366.216396:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305366.216406:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788305366.216412:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fbaf204000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788305366.216416:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf204000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788305366.216421:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788305366.216510:0:13027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fb8951b000 1 00000020:00000080:2.0:1788305366.216518:0:13027:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8169 00000020:00000080:2.0:1788305366.216526:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fba07ef800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788305366.217096:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788305366.217104:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305366.217110:0:13027:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788305366.217115:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff96fb8502cd28) has no exports 00000020:00000080:1.0:1788305366.224039:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fba07ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788305366.323797:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305366.323814:0:13027:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788305366.323819:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb8895f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788305366.323823:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8895f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788305366.323834:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788305366.323960:0:13027:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96fb8951c800 00000020:01000000:1.0:1788305366.323995:0:13027:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788305366.323999:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305366.324003:0:13027:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305366.324007:0:13027:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff96fba0520000) has no exports 00000100:00100000:1.0:1788305366.324100:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96fba974b200:5834] 2 exiting: rc = 0 00000100:00100000:1.0:1788305366.324253:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96fb830d3000:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1788305366.330023:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff96fb830d3600:5832] 0 exiting: rc = 1 00000100:00100000:3.0:1788305366.333875:0:8201:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff96fbb9e58400:8201] 3 exiting: rc = 0 00000100:00100000:1.0:1788305366.334104:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334114:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334121:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334127:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334133:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334138:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334144:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334149:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334154:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334159:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334164:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334170:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334174:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334180:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334198:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334203:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334211:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334220:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334228:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334242:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334249:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334256:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334263:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334272:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334279:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334289:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334296:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334301:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334308:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334313:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334319:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334326:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334332:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334337:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334342:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334347:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334352:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334358:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334364:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334369:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334375:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334381:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334386:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334392:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334398:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334403:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334408:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334414:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334421:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334436:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334442:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334462:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334470:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334478:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334483:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334490:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334498:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334505:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334511:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334517:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334523:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334529:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334536:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.334542:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.349552:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96fba0241400:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1788305366.350134:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96fba974aa00:5836] 1 exiting: rc = 0 00000100:00100000:2.0:1788305366.350238:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350245:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350252:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350258:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350263:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350269:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350275:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350281:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350288:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350293:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350372:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350384:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350392:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350397:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350402:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350424:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350434:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350458:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350469:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350478:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350487:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350497:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350507:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350520:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350532:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350544:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350554:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350560:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350565:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350571:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350577:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350583:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350588:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350693:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350700:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350706:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350712:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350721:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350732:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350744:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350752:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350762:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350773:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350785:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350795:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350805:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350817:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350826:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350835:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350843:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350869:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350878:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350886:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350895:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350903:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350912:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350921:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350931:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350942:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350953:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350965:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350975:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350985:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.350996:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305366.359285:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff96fb90729400:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1788305366.359460:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96fb90729000:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1788305366.360336:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360346:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360353:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360359:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360365:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360373:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360387:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360402:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360414:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360424:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360435:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360484:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360498:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360512:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360525:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360535:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360545:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360554:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360568:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360581:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.360589:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362144:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362154:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362191:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362204:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362220:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362233:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362250:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362267:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362286:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362302:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362311:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362316:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362321:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362327:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362351:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362359:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362367:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362379:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362393:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362405:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362418:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362427:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362438:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362473:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362489:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362505:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.362567:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367365:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367390:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367405:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367424:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367434:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367455:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367484:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367501:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367539:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367556:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.367573:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.368037:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.368091:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.368104:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.368114:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.368125:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405225:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff96fba0558600:5840] 1 exiting: rc = 0 00000100:00100000:1.0:1788305366.405512:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96fba0557c00:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1788305366.405619:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405627:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405633:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405639:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405644:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405650:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405655:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405661:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405666:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405671:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405676:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405681:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405687:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405693:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405698:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405703:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405708:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405714:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405720:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405725:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405730:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405750:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405756:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405761:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405767:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405773:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405778:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405782:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405787:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405791:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405797:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405801:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405806:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405811:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405816:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405821:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405827:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405832:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405837:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405842:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405847:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405852:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405857:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405862:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405867:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405872:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405877:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405882:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405886:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405891:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405896:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405911:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405918:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405924:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405929:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405934:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405949:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405954:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405959:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405963:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405968:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405973:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405978:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.405984:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406594:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff96fba0557000:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1788305366.406740:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff96fba0558e00:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1788305366.406836:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406843:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406849:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406855:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406861:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406866:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406872:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406878:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406885:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406890:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406896:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406912:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406918:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406924:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406930:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406936:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406940:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406946:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406951:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406956:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406961:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406966:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406972:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406978:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406983:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.406989:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407005:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407011:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407015:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407021:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407026:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407031:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407035:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407041:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407047:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407172:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407178:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407184:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407189:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407194:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407200:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407205:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407212:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407217:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407223:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407229:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407235:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407241:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407246:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407253:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407258:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407264:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407271:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407277:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407281:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407286:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407303:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407309:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407317:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407321:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407326:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407339:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407344:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.407349:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305366.408173:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff96fbb8893000:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1788305366.414118:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff96fbb8893400:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1788305366.414396:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414410:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414419:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414426:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414435:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414443:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414463:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414471:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414480:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414489:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414498:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414507:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414514:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414522:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414530:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414539:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414547:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414557:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414566:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414575:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.414583:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415042:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415092:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415101:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415112:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415123:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415128:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415155:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415160:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415166:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415172:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415181:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415189:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415196:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415203:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415211:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415219:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415227:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415235:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415244:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415254:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415264:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415275:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415285:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415402:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415424:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415439:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415463:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415477:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415490:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415503:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415521:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415536:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415545:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415555:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415562:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415585:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415846:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415861:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415870:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415880:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415891:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415919:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305366.415931:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.425895:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff96fbb8903e00:5847] 2 exiting: rc = 0 00000100:00100000:1.0:1788305366.426734:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff96fbb8902a00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1788305366.427011:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff96fbb8902800:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1788305366.427253:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427263:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427270:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427276:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427283:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427361:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427371:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427377:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427384:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427391:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427398:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427404:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427411:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427417:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427424:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427430:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427437:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427442:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427459:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427466:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427473:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427479:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427486:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427492:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427511:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427520:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427525:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427532:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427538:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427543:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427619:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427625:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427631:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427638:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427644:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427651:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427658:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427664:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427669:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427674:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427681:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427686:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427692:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427698:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427704:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427710:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427717:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427722:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427743:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427750:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427755:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427762:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427767:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427773:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427780:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427787:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427793:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427799:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427805:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427810:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427817:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427824:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427830:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305366.427838:0:13027:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788305366.439612:0:13027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305366.439657:0:13027:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788305366.439666:0:13027:0:(genops.c:885:class_export_put()) final put ffff96fb8895a000/MDS_uuid 00000020:00000080:3.0:1788305366.439674:0:13027:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8895a000/MDS_uuid for MDS 00000020:01000000:3.0:1788305366.439693:0:13027:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788305366.439861:0:13027:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788305366.965796:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305367.919530:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788305367.919539:0:7633:0:(genops.c:885:class_export_put()) final put ffff96fbaf4f5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788305367.921194:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf4f5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788305367.921463:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbaf4f7800 for lustre-OST0001 00010000:00010000:2.0:1788305367.988106:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305369.009850:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305369.603554:0:13177:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788305369.610506:0:13177:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788305369.610553:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305369.610569:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305369.610577:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305369.610585:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305369.610606:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788305369.610612:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788305369.610628:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788305369.610637:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788305369.610637:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305369.610644:0:13177:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788305369.610652:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490200 already unused, calling callback (ffffffffc1c0cc20) 00000100:00080000:3.0:1788305369.610653:0:13177:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1788305369.610657:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305369.610668:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305369.610676:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305369.610678:0:13177:0:(import.c:65:import_set_state_nolock()) ffff96fa81b47000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1788305369.610686:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305369.610691:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788305369.610693:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788305369.610719:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305369.610725:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305369.610750:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305369.610757:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81490200/0x902a3611c9ae84aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x902a3611c9ae84b1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305369.610765:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761439616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305369.610779:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305369.610781:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305369.610783:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305369.610940:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875173761439488:0@lo:39:umount.0 00000400:00000100:0.0:1788305369.610972:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875173761439488 offset 0 length 224: 4 00000100:00100000:1.0:1788305369.610975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305369.611013:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761439616 00000100:00100000:2.0:1788305369.611020:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761439616 00000100:00100000:1.0:1788305369.611075:0:8499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305369.611082:0:8499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3301:x1875173761439616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788305369.611089:0:8499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305369 with bad export cookie 10388174940509471123 00000100:00100000:1.0:1788305369.615628:0:8499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3301:x1875173761439616:12345-0@lo:103:ldlm_bl.0 Request processed in 4536us (4645us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788305369.615642:0:8499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788305369.615645:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788305369.615651:0:3301:0:(import.c:65:import_set_state_nolock()) ffff96fba07e8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788305369.615655:0:3301:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788305369.619985:0:3301:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.138@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788305369.619990:0:3301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788305369.620001:0:3301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96fa83230380 x1875173761439616/t0(0) o103->MGC192.168.201.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305385 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788305369.620015:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788305369.620018:0:3301:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788305369.620019:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788305369.620022:0:3301:0:(import.c:65:import_set_state_nolock()) ffff96fba07e8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305369.620028:0:3301:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 151 00000100:00080000:2.0:1788305369.620035:0:3301:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff96fba07e8800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305369.620152:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fb90f5dc00 x1875173761439744/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305369.620192:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:16674bd8-0f21-440d-92a6-ff3988850e9b:3301:1875173761439616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305369.621215:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16674bd8-0f21-440d-92a6-ff3988850e9b:3300:1875173761439744:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788305369.621278:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875173761439744 offset 0 length 520: 4 00000001:00100000:1.0:1788305369.906471:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788305369.906492:0:6702:0:(genops.c:885:class_export_put()) final put ffff96fa81b41000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788305369.906595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa81b41000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788305369.906663:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fa81b45000 for lustre-OST0000 00010000:00010000:2.0:1788305370.033362:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305370.865255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305370.865265:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788305370.865361:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761439872:0@lo:400:kworker.0 00000400:00000100:3.0:1788305370.865443:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875173761439872 offset 0 length 224: 4 00010000:00010000:2.0:1788305371.058271:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305372.081504:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305373.105317:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305374.131306:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305374.897266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305374.897278:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305374.897419:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305374.897446:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875173761440000:0@lo:400:kworker.0 00000400:00000100:1.0:1788305374.897505:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875173761440000 offset 0 length 224: 4 00010000:00010000:2.0:1788305375.153266:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305376.177253:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305377.203788:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305378.226110:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305379.058114:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305369/real 1788305369] req@ffff96fb90f5dc00 x1875173761439744/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305379 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305379.058171:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fb90f5dc00 x1875173761439744/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305379 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305379.058181:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305369/real 1788305369] req@ffff96fb90f5d500 x1875173761439488/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305379 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305379.058191:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fb90f5d500 x1875173761439488/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305379 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788305379.058208:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fba07e8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305379.058244:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788305379.058249:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16674bd8-0f21-440d-92a6-ff3988850e9b:3300:1875173761439744:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788305379.058255:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fa81b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788305379.058273:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875173761439488:0@lo:39:umount.0 00000100:00080000:1.0:1788305379.058513:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305379.058519:0:13177:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305379.058525:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788305379.059678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305379.059686:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788305379.059690:0:36:0:(import.c:65:import_set_state_nolock()) ffff96fba07e8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305379.059697:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 387 00000100:00080000:3.0:1788305379.059703:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788305379.059711:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff96fba07e8800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305379.059759:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fb90f5c700 x1875173761440128/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305379.059840:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305379.059856:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761440256:0@lo:400:kworker.0 00000400:00000100:3.0:1788305379.059906:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875173761440256 offset 0 length 224: 4 00010000:00010000:1.0:1788305379.060674:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060687:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060695:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060702:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305379.060821:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16674bd8-0f21-440d-92a6-ff3988850e9b:3300:1875173761440128:0@lo:250:kworker.0 00000400:00000100:2.0:1788305379.060848:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875173761440128 offset 0 length 520: 4 00010000:00010000:1.0:1788305379.060886:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305379.060895:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060902:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060908:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060927:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305379.060940:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788305379.060944:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788305379.060977:0:13177:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788305379.060981:0:13177:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788305379.060986:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305379.060992:0:13177:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305379.060996:0:13177:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96fa818c19b8) has no exports 00000020:00080000:1.0:1788305379.061019:0:13177:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96fa818c19b8) has no exports 00010000:00010000:3.0:1788305379.064683:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305379.064698:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064711:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fe00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305379.064716:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064739:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305379.064765:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305379.064771:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305379.064774:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788305379.064777:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788305379.064796:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:3.0:1788305379.064800:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064807:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb9071fe00/0x902a3611c9ae84b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae84bf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064824:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305379.064828:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064834:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305379.064837:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064843:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305379.064849:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305379.064855:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788305379.064857:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788305379.064865:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788305379.064872:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:3.0:1788305379.064875:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064881:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80031400/0x902a3611c9ae86ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae86f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305379.064890:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305379.064892:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305379.064894:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305379.065034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788305379.080351:0:13177:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fb895fba20 - data ffff96fbaa3ac510/ffff96fbbb42f400 00000020:01000000:1.0:1788305379.080496:0:13177:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fbaf46e3c0 - data ffff96fbaa343ca8/ffff96fa81ad6400 00100000:10000000:1.0:1788305379.093358:0:13177:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788305379.125555:0:13177:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae82c7 00000020:00000080:0.0:1788305379.125566:0:13177:0:(genops.c:885:class_export_put()) final put ffff96fb90ef8800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788305379.125586:0:13177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fbb95e7800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788305379.125590:0:13177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fbb95e7800 2 00000020:01000004:0.0:1788305379.125593:0:13177:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96fbb95e7800 from lustre-OST0000 00000020:00000080:0.0:1788305379.125618:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305379.125627:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788305379.125631:0:13177:0:(genops.c:885:class_export_put()) final put ffff96fbc1464800/lustre-OST0000_UUID 00000020:00000080:0.0:1788305379.125633:0:13177:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc1464800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788305379.125640:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788305379.125689:0:13177:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788305379.125694:0:13177:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788305379.125698:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305379.125702:0:13177:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305379.125709:0:13177:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96fa81b44800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305379.125715:0:13177:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff96fb85028000) has exports, disconnecting them 00000020:00080000:0.0:1788305379.125720:0:13177:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96fa81b44800), last request at 1788305151 00000020:00000080:0.0:1788305379.125724:0:13177:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae82f1 00000020:00080000:0.0:1788305379.125731:0:13177:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96fa81b44800): rc 0 00000020:00000080:0.0:1788305379.125737:0:13177:0:(genops.c:885:class_export_put()) final put ffff96fa81b44800/lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788305379.126351:0:13177:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788305379.126357:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305379.126361:0:13177:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788305379.126377:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788305379.126496:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305379.126501:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788305379.126505:0:13177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fbb95e7800 1 00000020:00000080:0.0:1788305379.126509:0:13177:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8281 00000020:00000080:0.0:1788305379.126514:0:13177:0:(genops.c:885:class_export_put()) final put ffff96fbc17ae000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788305379.126518:0:13177:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788305379.126522:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305379.126525:0:13177:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788305379.126528:0:13177:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff96fba0523370) has no exports 00000020:00000080:3.0:1788305379.126802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb90ef8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788305379.126815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa81b44800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788305379.126821:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fa81b47000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788305379.126827:0:8:0:(genops.c:885:class_export_put()) final put ffff96fbc1466000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788305379.126829:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc1466000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788305379.126832:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788305379.126872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc17ae000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788305379.171470:0:13177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305379.171488:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788305379.171494:0:13177:0:(genops.c:885:class_export_put()) final put ffff96fbb95e5000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788305379.171498:0:13177:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbb95e5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788305379.171505:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788305379.171640:0:13177:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96fbb95e6800 00000020:02000400:3.0:1788305379.171686:0:13177:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788305379.317495:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305380.337480:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305381.362450:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305382.350563:0:13331:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788305382.365774:0:13331:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788305382.365864:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305382.365881:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305382.365889:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305382.365896:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305382.365924:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788305382.365931:0:13331:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788305382.365961:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305382.365974:0:13331:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96fbaf58ed80 x1875173761439872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305382.365999:0:13331:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96fb90f5ed80 x1875173761440000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305382.366166:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761439872:0@lo:400:kworker.0 00000100:00100000:1.0:1788305382.366278:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875173761440000:0@lo:400:kworker.0 00010000:00010000:3.0:1788305382.366323:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305382.366354:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305382.366363:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb81490600 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305382.366367:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305382.366376:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305382.366383:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305382.366388:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305382.366391:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788305382.366394:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788305382.366410:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:3.0:1788305382.366415:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305382.366422:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81490600/0x902a3611c9ae848e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae8495 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305382.366435:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305382.366437:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305382.366439:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305382.366560:0:13331:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96fb90f5ea00 x1875173761440256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305382.366667:0:13331:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788305382.366675:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305382.366696:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875173761440256:0@lo:400:kworker.0 00000100:00080000:0.0:1788305382.367157:0:13331:0:(import.c:65:import_set_state_nolock()) ffff96fbc1465000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788305382.367222:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875173761440384:0@lo:39:umount.0 00000400:00000100:2.0:1788305382.367290:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875173761440384 offset 0 length 224: 4 00010000:00010000:3.0:1788305382.385299:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305383.414538:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305384.177329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305384.177358:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788305384.433973:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305385.461348:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305386.481571:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305387.505611:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305388.529389:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788305389.297293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305389.297304:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788305389.554446:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305390.577671:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305391.601722:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305392.561868:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305382/real 1788305382] req@ffff96fbaf27a300 x1875173761440384/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305392 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305392.561946:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fbaf27a300 x1875173761440384/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305392 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788305392.561971:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc1465000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788305392.562084:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875173761440384:0@lo:39:umount.0 00000100:00080000:0.0:1788305392.568877:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305392.568891:0:13331:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788305392.568901:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788305392.570907:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.570932:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.570941:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.570949:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.570983:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305392.570993:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.571010:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.571017:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.571024:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305392.571104:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788305392.571111:0:13331:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788305392.571145:0:13331:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788305392.571151:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788305392.571157:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305392.571164:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788305392.571170:0:13331:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff96fbaf4ecd28) has no exports 00000020:00080000:0.0:1788305392.571204:0:13331:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff96fbaf4ecd28) has no exports 00010000:00010000:3.0:1788305392.573252:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305392.573273:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573289:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7cc00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305392.573295:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573308:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305392.573318:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305392.573324:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305392.573327:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788305392.573343:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788305392.573370:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:3.0:1788305392.573375:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573383:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb87d7cc00/0x902a3611c9ae849c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae84a3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573434:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305392.573440:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573446:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e600 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:3.0:1788305392.573449:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573456:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305392.573463:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305392.573468:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788305392.573470:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788305392.573472:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788305392.573478:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:3.0:1788305392.573481:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573487:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb9071e600/0x902a3611c9ae86e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae86e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305392.573502:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305392.573504:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305392.573507:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305392.573671:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788305392.576447:0:13331:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fb895fb5a0 - data ffff96fba57a81b0/ffff96fbbb42cc00 00000020:01000000:0.0:1788305392.576856:0:13331:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96fbb981c120 - data ffff96fba57b6798/ffff96fbb9e53000 00100000:10000000:0.0:1788305392.593916:0:13331:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:3.0:1788305392.626032:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305392.649099:0:13331:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8392 00000020:00000080:1.0:1788305392.649113:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fbaf4f7000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788305392.649132:0:13331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fa818a7800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788305392.649137:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fa818a7800 2 00000020:01000004:1.0:1788305392.649280:0:13331:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96fa818a7800 from lustre-OST0001 00000020:00000080:1.0:1788305392.649451:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305392.649465:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788305392.649469:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fbbd7f4800/lustre-OST0001_UUID 00000020:00000080:1.0:1788305392.649473:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbbd7f4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788305392.649482:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788305392.649807:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 16674bd8-0f21-440d-92a6-ff3988850e9b->MGS 00010000:00010000:1.0:1788305392.649830:0:13331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305392.649862:0:13331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305392.649869:0:13331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788305392.649873:0:13331:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788305392.649877:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788305392.649901:0:13331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:1.0:1788305392.649905:0:13331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb81490400/0x902a3611c9ae82a4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae82ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305392.649925:0:13331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305392.649932:0:13331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305392.649938:0:13331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788305392.649940:0:13331:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788305392.649942:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788305392.649954:0:13331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96fba07e8800 00010000:00010000:1.0:1788305392.649957:0:13331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80030000/0x902a3611c9ae84e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x902a3611c9ae84e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788305392.649977:0:13331:0:(import.c:65:import_set_state_nolock()) ffff96fba07e8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788305392.649982:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788305392.649985:0:13331:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788305392.649987:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788305392.650003:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788305392.650020:0:13331:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96fb90f5c700 x1875173761440128/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788305394 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788305392.650107:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788305392.650111:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:3.0:1788305392.650268:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf4f7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788305392.650545:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:16674bd8-0f21-440d-92a6-ff3988850e9b:3300:1875173761440128:0@lo:250:kworker.0 10000000:01000000:1.0:1788305392.650611:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788305392.650622:0:13331:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8185 00000020:00000080:1.0:1788305392.650631:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fba07ec000/16674bd8-0f21-440d-92a6-ff3988850e9b 00000020:01000000:1.0:1788305392.650649:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.138@tcp (flags='') 00000020:00000080:1.0:1788305392.650656:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305392.650730:0:13331:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305392.650738:0:13331:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff96fba05219b8) has no exports 00000020:00000080:3.0:1788305392.650805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fba07ec000/16674bd8-0f21-440d-92a6-ff3988850e9b for MGC192.168.201.138@tcp 10000000:01000000:0.0:1788305392.651120:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788305392.651611:0:13331:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.138@tcp: client import never connected 00000100:00080000:1.0:1788305392.651617:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788305392.651622:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788305392.651625:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788305392.651628:0:13331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788305392.651752:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fba07e8800 for MGC192.168.201.138@tcp 00000020:00000080:1.0:1788305392.651827:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305392.651839:0:13331:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.138@tcp (uuid 16674bd8-0f21-440d-92a6-ff3988850e9b) 00000020:00000080:1.0:1788305392.651843:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fb8895e000/16674bd8-0f21-440d-92a6-ff3988850e9b 00000020:00000080:1.0:1788305392.651846:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff96fb8895e000/16674bd8-0f21-440d-92a6-ff3988850e9b for MGC192.168.201.138@tcp 00000020:01000000:1.0:1788305392.651856:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.138@tcp (16674bd8-0f21-440d-92a6-ff3988850e9b) 00000020:01000000:1.0:1788305392.652524:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788305392.652532:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305392.652540:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788305392.652548:0:13331:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff96fbaf550800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305392.652555:0:13331:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff96fb8502b370) has exports, disconnecting them 00000020:00080000:1.0:1788305392.652560:0:13331:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff96fbaf550800), last request at 1788305169 00000020:00000080:1.0:1788305392.652566:0:13331:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae83bc 00000020:00080000:1.0:1788305392.652582:0:13331:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96fbaf550800): rc 0 00000020:00000080:1.0:1788305392.652586:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fbaf550800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788305392.653888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbaf550800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788305392.654149:0:13331:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788305392.654155:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305392.654160:0:13331:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788305392.654167:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305392.654494:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96fbc1465000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788305392.656121:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788305392.656640:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788305392.656901:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff96fb83061000:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1788305392.658249:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96fb83061800:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1788305392.658647:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.658959:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff96fb83060200:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1788305392.659080:0:8499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96fbc1322a00:8499] 3 exiting: rc = 0 00000100:00100000:3.0:1788305392.660164:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96fb83060a00:5820] 2 exiting: rc = 0 00000100:00100000:0.0:1788305392.661184:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96fb83060e00:5819] 1 exiting: rc = 0 00000100:00100000:3.0:1788305392.661345:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661357:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661364:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661372:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661379:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661386:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661394:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661400:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661408:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661416:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661423:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661429:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661436:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661445:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661457:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661464:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661473:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661479:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661485:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661492:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661499:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661506:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661512:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661535:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661541:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661548:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661554:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661560:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661567:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661572:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661578:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661584:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661591:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661597:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661603:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661609:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661616:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661621:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661628:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661635:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661641:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661647:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661653:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661660:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661677:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661684:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661690:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661697:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661703:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661709:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661716:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661723:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661729:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661736:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661742:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661749:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661755:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661761:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661775:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661783:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661789:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661796:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661802:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.661808:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788305392.663600:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305392.663617:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788305392.663625:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fbc1463000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788305392.663632:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc1463000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788305392.663640:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788305392.663717:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fa818a7800 1 00000020:00000080:3.0:1788305392.663725:0:13331:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x902a3611c9ae8361 00000020:00000080:3.0:1788305392.663734:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fa81b40800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788305392.663757:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788305392.663764:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305392.663769:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788305392.663775:0:13331:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff96fb90f48000) has no exports 00000020:00000080:0.0:1788305392.663937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa81b40800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788305392.686890:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305392.686915:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788305392.686923:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fa818a0000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788305392.686930:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff96fa818a0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788305392.686946:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788305392.687261:0:13331:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96fa818a5800 00000020:01000000:3.0:1788305392.687305:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788305392.687311:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305392.687317:0:13331:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788305392.687322:0:13331:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff96fb90f499b8) has no exports 00000020:00000080:3.0:1788305392.687372:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305392.687379:0:13331:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788305392.687382:0:13331:0:(genops.c:885:class_export_put()) final put ffff96fbc17ad800/OSS_uuid 00000020:00000080:3.0:1788305392.687385:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff96fbc17ad800/OSS_uuid for OSS 00000020:01000000:3.0:1788305392.687388:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788305392.687430:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788305392.687654:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96fbc0fbd000:6675] 0 exiting: rc = 1 00000100:00100000:1.0:1788305392.688111:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96fb8388ae00:6677] 1 exiting: rc = 0 00000100:00100000:1.0:1788305392.688198:0:11977:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96fb892bc400:11977] 3 exiting: rc = 0 00000100:00100000:2.0:1788305392.699830:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96fbc0fbcc00:6678] 2 exiting: rc = 0 00000100:00100000:3.0:1788305392.702301:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702319:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702332:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702399:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702407:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702414:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702420:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702426:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702432:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702437:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702443:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702448:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702454:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702460:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702466:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702473:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702479:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702485:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702492:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702498:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702504:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702510:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702516:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.702522:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703292:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703304:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703311:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703319:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703326:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703333:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703342:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703351:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703360:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703385:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703391:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703397:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703403:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703654:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703664:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703672:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703680:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703687:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703695:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703701:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703708:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703714:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703722:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703728:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703734:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703753:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703761:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703768:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703783:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703790:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703804:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703811:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703824:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703835:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703840:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703846:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703852:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703858:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703865:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.703871:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.705443:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96fb8316a400:6679] 0 exiting: rc = 1 00000100:00100000:1.0:1788305392.705787:0:10122:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff96fb8916c000:10122] 2 exiting: rc = 0 00000100:00100000:1.0:1788305392.705969:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96fb8388bc00:6680] 1 exiting: rc = 0 00000100:00100000:0.0:1788305392.706319:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706329:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706336:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706342:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706351:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706379:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706386:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706399:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706406:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706412:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706417:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706427:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706434:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706439:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706445:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706450:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706456:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706462:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706468:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706474:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706481:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706492:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706499:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706506:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706512:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706518:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706523:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706529:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706536:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706542:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706548:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706554:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706560:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706567:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706572:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706578:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706584:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706590:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706825:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706837:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706850:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706868:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706876:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706882:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706887:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706893:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706898:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706904:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706911:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706919:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706926:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706933:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706938:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706944:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706952:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706960:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706968:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706974:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706980:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.706987:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.707004:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.707011:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.707019:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.707037:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.709035:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96fb8388b800:6681] 0 exiting: rc = 1 00000100:00100000:0.0:1788305392.709099:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96fb892bde00:6683] 2 exiting: rc = 0 00000100:00100000:0.0:1788305392.709591:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96fb8388ba00:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1788305392.709827:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709853:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709936:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709944:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709950:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709961:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709969:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709977:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.709983:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710019:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710114:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710129:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710254:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710267:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710274:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710280:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710291:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710301:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710310:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710317:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710325:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710332:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710339:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710347:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710363:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710397:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710405:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710413:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710420:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710426:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710432:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710439:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710445:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710451:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710458:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710464:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710477:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710483:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710490:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710497:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710503:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710511:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710517:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710523:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710538:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710544:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710550:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710557:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710564:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710585:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710593:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710678:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710685:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710690:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710762:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710923:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710936:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710946:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710952:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710958:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710969:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710976:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710982:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.710989:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.720643:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96fbb9873600:6684] 0 exiting: rc = 1 00000100:00100000:1.0:1788305392.721391:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff96fbb9873000:6685] 1 exiting: rc = 0 00000100:00100000:0.0:1788305392.721452:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721464:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721470:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721477:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721483:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721489:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721495:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721501:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721506:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721512:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721519:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721525:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721530:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721535:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721542:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721561:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721567:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721574:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721637:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721644:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721650:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721656:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721663:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721668:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721674:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721680:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721685:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721691:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721696:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721702:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721708:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721713:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721718:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721723:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721729:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721735:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721740:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721745:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721750:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721756:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721762:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721768:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721842:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721848:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721855:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721861:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721867:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721874:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721880:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721886:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721900:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721906:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721913:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721919:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721925:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721931:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721937:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721943:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721949:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721954:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721959:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721965:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721971:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.721977:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305392.723504:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96fb90fc3e00:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788305392.723943:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96fbb9872800:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788305392.724136:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724147:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724154:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724162:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724189:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724198:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724206:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724214:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724222:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724230:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724239:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724247:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724257:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724267:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724274:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724285:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724311:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724322:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724332:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724339:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724350:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724380:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724389:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724398:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724408:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724417:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724426:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724434:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724459:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724468:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724476:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724484:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724493:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724500:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724507:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724514:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724521:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724527:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724534:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724540:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724562:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724569:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724577:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724848:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724858:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724866:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724873:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724881:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724890:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724897:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724904:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724912:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724935:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724945:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724954:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724962:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724979:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.724987:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.725008:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.725017:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.725025:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.725033:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.725042:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305392.725049:0:13331:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788305392.739349:0:13331:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788305407.933774:0:13949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788305416.187917:0:14411:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305416.187933:0:14411:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788305416.188045:0:14411:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96fbb9972000 00000020:01000004:3.0:1788305416.188084:0:14411:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788305416.188093:0:14411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788305416.188109:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96fb8502b370) 00000020:00000080:3.0:1788305416.188123:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788305416.228617:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788305416.232256:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788305416.235377:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788305416.235490:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1788305416.235674:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788305416.235793:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1788305416.236491:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788305416.236615:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788305416.236702:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788305416.237326:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1788305416.246228:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:3.0:1788305416.246869:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:3.0:1788305416.249200:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 331: rc = 0 00100000:10000000:3.0:1788305416.249613:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 331: rc = 0 00100000:10000000:3.0:1788305416.250032:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 331: rc = 0 00100000:10000000:3.0:1788305416.250331:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 331: rc = 0 00100000:10000000:3.0:1788305416.250575:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 331: rc = 0 00100000:10000000:3.0:1788305416.250853:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 331: rc = 0 00100000:10000000:3.0:1788305416.251612:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 331: rc = 0 00100000:10000000:3.0:1788305416.252387:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 331: rc = 0 00100000:10000000:3.0:1788305416.252986:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 331: rc = 0 00100000:10000000:3.0:1788305416.253980:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 331: rc = 0 00100000:10000000:3.0:1788305416.255370:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 331: rc = 0 00100000:10000000:3.0:1788305416.255657:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 331: rc = 0 00100000:10000000:2.0:1788305416.262851:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 652: rc = 0 00100000:10000000:2.0:1788305416.263582:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 652: rc = 0 00100000:10000000:2.0:1788305416.264416:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 652: rc = 0 00100000:10000000:2.0:1788305416.264704:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 652: rc = 0 00100000:10000000:2.0:1788305416.264969:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 652: rc = 0 00100000:10000000:2.0:1788305416.265244:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 652: rc = 0 00100000:10000000:2.0:1788305416.265477:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 652: rc = 0 00100000:10000000:2.0:1788305416.265739:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 652: rc = 0 00100000:10000000:2.0:1788305416.266005:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 652: rc = 0 00100000:10000000:2.0:1788305416.268244:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 652: rc = 0 00100000:10000000:2.0:1788305416.268571:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 652: rc = 0 00100000:10000000:2.0:1788305416.269337:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 652: rc = 0 00100000:10000000:2.0:1788305416.269644:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 652: rc = 0 00100000:10000000:2.0:1788305416.270307:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 652: rc = 0 00100000:10000000:2.0:1788305416.270665:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 652: rc = 0 00100000:10000000:2.0:1788305416.271667:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 652: rc = 0 00100000:10000000:2.0:1788305416.272479:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 652: rc = 0 00100000:10000000:2.0:1788305416.273025:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 652: rc = 0 00100000:10000000:2.0:1788305416.273318:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 652: rc = 0 00100000:10000000:2.0:1788305416.273574:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 652: rc = 0 00100000:10000000:2.0:1788305416.273998:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 652: rc = 0 00100000:10000000:2.0:1788305416.274286:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 652: rc = 0 00100000:10000000:2.0:1788305416.274763:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 652: rc = 0 00100000:10000000:2.0:1788305416.276079:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 652: rc = 0 00100000:10000000:2.0:1788305416.276489:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 652: rc = 0 00100000:10000000:2.0:1788305416.277746:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 652: rc = 0 00100000:10000000:2.0:1788305416.278467:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 652: rc = 0 00100000:10000000:2.0:1788305416.281822:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 652: rc = 0 00100000:10000000:2.0:1788305416.282653:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 652: rc = 0 00100000:10000000:2.0:1788305416.283653:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 652: rc = 0 00100000:10000000:3.0:1788305416.292478:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 652: rc = 0 00100000:10000000:3.0:1788305416.292962:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 652: rc = 0 00100000:10000000:3.0:1788305416.293415:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 460: rc = 0 00100000:10000000:3.0:1788305416.293941:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788305416.294133:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 596: rc = 0 00100000:10000000:3.0:1788305416.294304:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788305416.294361:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 596: rc = 0 00100000:10000000:3.0:1788305416.294522:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788305416.294581:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 596: rc = 0 00100000:10000000:3.0:1788305416.294918:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788305416.294981:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1788305416.295191:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788305416.295257:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:3.0:1788305416.295443:0:14411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788305416.295512:0:14411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00000020:00000080:3.0:1788305416.303988:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788305416.304001:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788305416.304017:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae9486 00000020:01000004:3.0:1788305416.304025:0:14411:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788305416.304030:0:14411:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788305416.304038:0:14411:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96fbb9972000 from MGS 00000020:01000004:3.0:1788305416.304042:0:14411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788305416.304561:0:14411:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96fb85028000) 00000020:00000080:3.0:1788305416.304579:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788305416.304682:0:14411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbb9972000 from MGS, refs=2 00080000:01000000:3.0:1788305416.304689:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788305416.304695:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae9494 00000100:00100000:3.0:1788305416.304911:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788305416.305103:0:14411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788305416.305109:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788305416.306311:0:14411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788305416.306323:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788305416.307166:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305416.307326:0:14411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788305416.307331:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788305416.308534:0:14411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788305416.308544:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788305416.309296:0:14411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788305416.309303:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788305416.310165:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305416.310169:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305416.310171:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305416.310549:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305416.310551:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305416.310553:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305416.315688:0:14411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788305416.320297:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788305416.373552:0:14411:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788305416.373570:0:14411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788305416.373573:0:14411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788305416.396991:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788305416.401195:0:14411:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788305416.401341:0:14411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788305416.401888:0:14411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788305416.402208:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305416.402379:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788305416.402385:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788305416.411475:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788305416.411485:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788305416.412538:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788305416.412544:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788305416.413508:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788305416.413527:0:14411:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.138@tcp' 00000020:01000004:3.0:1788305416.413529:0:14411:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788305416.413560:0:14411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.138@tcp (typ=mgc) 00000020:00000080:3.0:1788305416.413573:0:14411:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.138@tcp (ffff96fb8502cd28) 00000020:00000080:3.0:1788305416.413599:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788305416.413672:0:14411:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fa81b47000@MGC192.168.201.138@tcp: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788305416.414017:0:14411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.138@tcp-0 is initialized 00000040:01000000:3.0:1788305416.414023:0:14411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788305416.414688:0:14426:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788305416.414836:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.138@tcp (uuid 6f68cc6e-21eb-4cf1-9001-76dd2ceefc68) 00000020:00000080:1.0:1788305416.414855:0:14411:0:(genops.c:1385:class_connect()) connect: client 6f68cc6e-21eb-4cf1-9001-76dd2ceefc68, cookie 0x902a3611c9ae94a2 00000100:00080000:1.0:1788305416.414865:0:14411:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305416.414871:0:14411:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff96fa81b47000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305416.414902:0:14411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf58c380 x1875173761440512/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305416.414932:0:14411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6f68cc6e-21eb-4cf1-9001-76dd2ceefc68->MGS 00000020:01000004:1.0:1788305416.414952:0:14411:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788305416.414975:0:14411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788305416.414988:0:14411:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96fb90f4b370) 00000100:00100000:2.0:1788305416.414993:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3300:1875173761440512:0@lo:250:mount.lustre.0 00000020:00000080:1.0:1788305416.414999:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788305416.415084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305416.415160:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761440512 00000100:00100000:2.0:1788305416.415169:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761440512 00000100:00100000:2.0:1788305416.415199:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305416.415206:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1875173761440512:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788305416.415232:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6f68cc6e-21eb-4cf1-9001-76dd2ceefc68@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1788305416.415259:0:14422:0:(genops.c:1385:class_connect()) connect: client 6f68cc6e-21eb-4cf1-9001-76dd2ceefc68, cookie 0x902a3611c9ae94b0 00000100:00080000:2.0:1788305416.415419:0:14422:0:(import.c:65:import_set_state_nolock()) ffff96fbbd326800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305416.415471:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+5:3300:x1875173761440512:12345-0@lo:250:mount.lustre.0 Request processed in 264us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305416.415479:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305416.415517:0:3300:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788305416.415525:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1788305416.415532:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788305416.415536:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788305416.415539:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fa81b47000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788305416.415542:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788305416.415548:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788305416.415553:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3300:1875173761440512:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788305416.416263:0:14425:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788305416.431288:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305416.431654:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788305416.431662:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788305416.437931:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305416.437949:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788305416.441409:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305416.441420:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788305416.444385:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305416.444596:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788305416.444604:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788305416.445528:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788305416.445536:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788305416.484932:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305416.485169:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788305416.485184:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788305416.488170:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788305416.488200:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788305416.488810:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305416.488985:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788305416.488990:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788305416.489627:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788305416.489634:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788305416.490221:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305416.490369:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788305416.490373:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788305416.490765:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788305416.490772:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788305416.491439:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305416.491570:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788305416.491575:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788305416.491982:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788305416.491988:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788305416.505940:0:14411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305416.506312:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788305416.506319:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788305416.507442:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788305416.507451:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788305416.508220:0:14411:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788305416.508228:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788305416.508950:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788305416.508976:0:14411:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788305416.508983:0:14411:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788305416.509327:0:14411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788305416.509362:0:14411:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788305416.509367:0:14411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788305416.509368:0:14411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305416.509369:0:14411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305416.509370:0:14411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305416.509371:0:14411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305416.509373:0:14411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305416.509374:0:14411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305416.509375:0:14411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305416.509377:0:14411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305416.509379:0:14411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788305416.509381:0:14411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788305416.509383:0:14411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305416.509385:0:14411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305416.509386:0:14411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305416.509387:0:14411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305416.509388:0:14411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305416.509389:0:14411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305416.509390:0:14411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305416.509391:0:14411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305416.509392:0:14411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305416.509393:0:14411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788305416.509421:0:14411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788305416.509441:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761440640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305416.509512:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305416.509607:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0492900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305416.509651:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761440640 00000100:00100000:2.0:1788305416.509659:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761440640 00000100:00100000:2.0:1788305416.509702:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305416.509713:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+5:14411:x1875173761440640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305416.509763:0:14424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788305416.509767:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788305416.509770:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788305416.510111:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788305416.510448:0:14424:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788305416.511410:0:14446:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788305416.511421:0:14446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788305416.511425:0:14446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788305416.511464:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788305416.511700:0:14424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788305416.511710:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788305416.518645:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+5:14411:x1875173761440640:12345-0@lo:253:mount.lustre.0 Request processed in 8923us (9121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.518664:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305416.518765:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761440640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788305416.518782:0:14411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788305416.518785:0:14411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788305416.518787:0:14411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788305416.518788:0:14411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305416.518789:0:14411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305416.518790:0:14411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305416.518791:0:14411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305416.518793:0:14411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788305416.518795:0:14411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788305416.518797:0:14411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305416.518808:0:14411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788305416.518829:0:14411:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96fbb9972000 from lustre-MDT0000 10000000:01000000:3.0:1788305416.518852:0:14411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788305416.518854:0:14411:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788305416.518858:0:14411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96fb8502cd28 10000000:01000000:3.0:1788305416.518862:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305416.518869:0:14411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96fb8502cd28 from 1 10000000:01000000:3.0:1788305416.518872:0:14411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788305416.518908:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.518919:0:14411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.518929:0:14411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.518947:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761440768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305416.518981:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305416.519074:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb911d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305416.519530:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761440768 00000100:00100000:2.0:1788305416.519538:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761440768 00000100:00100000:2.0:1788305416.519638:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305416.519646:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+5:14411:x1875173761440768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305416.519658:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305416.519672:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc2044000/0x902a3611c9ae94be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae94b7 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.519693:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2044000/0x902a3611c9ae94be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae94b7 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.519702:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc2044000/0x902a3611c9ae94be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae94b7 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.519712:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044000, rc 0) 00000100:00100000:2.0:1788305416.519756:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+6:14411:x1875173761440768:12345-0@lo:101:mount.lustre.0 Request processed in 110us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305416.519763:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305416.519831:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761440768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305416.519850:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.519858:0:14411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.519910:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761440896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305416.519936:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305416.520236:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb911d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305416.520330:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761440896 00000100:00100000:0.0:1788305416.520336:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761440896 00000100:00100000:0.0:1788305416.520358:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305416.520364:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+6:14411:x1875173761440896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305416.520602:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+6:14411:x1875173761440896:12345-0@lo:501:mount.lustre.0 Request processed in 236us (664us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305416.520619:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305416.520819:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761440896:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788305416.520847:0:14411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788305416.520860:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.520868:0:14411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305416.520876:0:14411:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96fbb9972000 10000000:01000000:3.0:1788305416.520881:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788305416.520885:0:14411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96fbb9972000 10000000:01000000:3.0:1788305416.520888:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788305416.520890:0:14411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96fbb9972000 from 1 10000000:01000000:3.0:1788305416.520893:0:14411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788305416.520913:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.520921:0:14411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.520940:0:14411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.520953:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305416.520979:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305416.520991:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb911d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305416.521196:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761441024 00000100:00100000:0.0:1788305416.521201:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761441024 00000100:00100000:0.0:1788305416.521224:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305416.521230:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+6:14411:x1875173761441024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305416.521238:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305416.521249:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870bf000/0x902a3611c9ae94cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae94c5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.521266:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870bf000/0x902a3611c9ae94cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae94c5 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.521275:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870bf000/0x902a3611c9ae94cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae94c5 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.521282:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf000, rc 0) 00000100:00100000:0.0:1788305416.521318:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+7:14411:x1875173761441024:12345-0@lo:101:mount.lustre.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305416.521324:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305416.521397:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305416.521409:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94cc expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521416:0:14411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae94cc expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305416.521428:0:14411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788305416.521443:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94cc expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521451:0:14411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbcc00/0x902a3611c9ae94c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94cc expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305416.521457:0:14411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788305416.521460:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305416.521464:0:14411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96fbb9972000 10000000:01000000:3.0:1788305416.521466:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788305416.521469:0:14411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788305416.521470:0:14411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788305416.521483:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521495:0:14411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521504:0:14411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.521515:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305416.521542:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305416.521559:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb911d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305416.521690:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761441152 00000100:00100000:2.0:1788305416.521707:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761441152 00000100:00100000:3.0:1788305416.521880:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305416.521887:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+7:14411:x1875173761441152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305416.521895:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305416.521904:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbb9dbd800/0x902a3611c9ae94da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae94d3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521919:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbb9dbd800/0x902a3611c9ae94da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae94d3 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521928:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbb9dbd800/0x902a3611c9ae94da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae94d3 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.521934:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbd800, rc 0) 00000100:00100000:3.0:1788305416.521966:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+8:14411:x1875173761441152:12345-0@lo:101:mount.lustre.0 Request processed in 80us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.521973:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305416.521978:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305416.521988:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94da expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.521996:0:14411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae94da expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305416.522045:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305416.522340:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305416.522415:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85241cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305416.522561:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761441280 00000100:00100000:2.0:1788305416.522566:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761441280 00000100:00100000:2.0:1788305416.522610:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305416.522618:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+8:14411:x1875173761441280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305416.523562:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14411:x1875173761441280:12345-0@lo:501:mount.lustre.0 Request processed in 943us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305416.523570:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305416.523650:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305416.523694:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305416.523813:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305416.523844:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85241cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305416.523902:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761441408 00000100:00100000:3.0:1788305416.523909:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761441408 00000100:00100000:3.0:1788305416.523951:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305416.523956:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14411:x1875173761441408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305416.524316:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14411:x1875173761441408:12345-0@lo:503:mount.lustre.0 Request processed in 358us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.524323:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305416.524416:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761441408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305416.524985:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14447:1875173761441536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305416.525297:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305416.525326:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb985803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.525526:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761441536 00000100:00100000:1.0:1788305416.525533:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761441536 00000100:00100000:1.0:1788305416.525572:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305416.525580:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14447:x1875173761441536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305416.526039:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14447:x1875173761441536:12345-0@lo:502:llog_process_th.0 Request processed in 458us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.526047:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305416.526249:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14447:1875173761441536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305416.526281:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305416.526292:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305416.526294:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788305416.526303:0:14447:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788305416.526306:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305416.526321:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96fbaf4e99b8) 00000020:00000080:2.0:1788305416.526339:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788305416.526344:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788305416.526405:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788305416.526411:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae94e8 00000020:00000080:2.0:1788305416.526620:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788305416.526625:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305416.526629:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305416.526630:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788305416.526633:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305416.526637:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305416.526639:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788305416.526642:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305416.526649:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96fbaf4e8000) 00000020:00000080:2.0:1788305416.526659:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788305416.526663:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788305416.526665:0:14447:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788305416.526668:0:14447:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788305416.526673:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305416.526710:0:14447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbb9972000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788305416.526723:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96fbaf4eb370) 00000020:00000080:2.0:1788305416.526730:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788305416.526771:0:14447:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788305416.526779:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae94fd 00000020:00000080:2.0:1788305416.527269:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788305416.527276:0:14447:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788305416.527281:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x902a3611c9ae9504 00080000:01000000:2.0:1788305416.527286:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788305416.527289:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae950b 00010000:00010000:0.0:1788305416.614504:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788305416.617413:0:14447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1788305416.617696:0:14447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788305416.620416:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96fa818c19b8) 00000020:00000080:0.0:1788305416.620440:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788305416.620514:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788305416.620521:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae9519 00000020:00000080:0.0:1788305416.623358:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788305416.644725:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x902a3611c9ae9520 00000020:00000080:1.0:1788305416.648286:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788305416.648302:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305416.648310:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.648312:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788305416.648317:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788305416.648320:0:14447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788305416.648321:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305416.648323:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305416.648324:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788305416.648327:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.648329:0:14447:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788305416.648331:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305416.648337:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.648338:0:14447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788305416.648343:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788305416.648394:0:14447:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788305416.648418:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305416.648421:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.648423:0:14447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788305416.648425:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788305416.648429:0:14447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788305416.648432:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.648434:0:14447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788305416.648436:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305416.648442:0:14447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:1.0:1788305416.648467:0:14447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788305416.648470:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305416.648485:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96fb90f499b8) 00000020:00000080:1.0:1788305416.648503:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788305416.648508:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305416.648565:0:14447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788305416.648571:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788305416.648578:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae952e 00010000:00080000:1.0:1788305416.648634:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fb98318800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788305416.648861:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788305416.654519:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788305416.654633:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788305416.658703:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305416.658891:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788305416.658968:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788305416.660977:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788305416.660985:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788305416.675214:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305416.675232:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788305416.675275:0:14447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788305416.675294:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae9535 00000100:00080000:1.0:1788305416.675305:0:14447:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305416.675310:0:14447:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96fb98318800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305416.675344:0:14447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf58f480 x1875173761441664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305416.675407:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761441664:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788305416.675465:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875173761441664 offset 0 length 520: 4 00000100:00080000:1.0:1788305416.675526:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788305416.675601:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305416.675606:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.675608:0:14447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788305416.675611:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788305416.675615:0:14447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788305416.675616:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305416.675618:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305416.675619:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788305416.675621:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.675622:0:14447:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788305416.675625:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788305416.675629:0:14447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788305416.675633:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305416.675641:0:14447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788305416.675646:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305416.675650:0:14447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:1.0:1788305416.675674:0:14447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788305416.675677:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305416.675689:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96fb90f48000) 00000020:00000080:1.0:1788305416.675702:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788305416.675707:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305416.676996:0:14447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788305416.677004:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788305416.677012:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x902a3611c9ae9543 00010000:00080000:1.0:1788305416.677043:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fba0333000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1788305416.677360:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788305416.677549:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788305416.677570:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788305416.679112:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305416.679251:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788305416.679338:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788305416.684605:0:14453:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788305416.684614:0:14453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788305416.689551:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305416.689567:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788305416.689619:0:14447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788305416.689640:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae954a 00000100:00080000:3.0:1788305416.689651:0:14447:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305416.689656:0:14447:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96fba0333000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305416.689695:0:14447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fb90f5c000 x1875173761441792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305416.689768:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761441792:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788305416.689855:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875173761441792 offset 0 length 520: 4 00000100:00080000:3.0:1788305416.690229:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788305416.690348:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305416.690354:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305416.690355:0:14447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788305416.690359:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305416.690364:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305416.690365:0:14447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305416.690368:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305416.690370:0:14447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305416.690372:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305416.690374:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305416.690375:0:14447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788305416.690378:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305416.690380:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305416.690381:0:14447:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788305416.690385:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788305416.690414:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14447:1875173761441920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305416.690473:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305416.690507:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb911d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305416.690625:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761441920 00000100:00100000:0.0:1788305416.690633:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761441920 00000100:00100000:0.0:1788305416.690689:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305416.690699:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14447:x1875173761441920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305416.690951:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14447:x1875173761441920:12345-0@lo:502:llog_process_th.0 Request processed in 252us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305416.690959:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305416.691146:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14447:1875173761441920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305416.691173:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305416.691178:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305416.691180:0:14447:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788305416.691184:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788305416.691429:0:14411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788305416.691452:0:14411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305416.691475:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94da expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.691487:0:14411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd000/0x902a3611c9ae94d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94da expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305416.691496:0:14411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fbb9972000 from 1 10000000:01000000:0.0:1788305416.691499:0:14411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305416.691528:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.691536:0:14411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.691546:0:14411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305416.691561:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305416.691606:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.691633:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82f4c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.693002:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442048 00000100:00100000:1.0:1788305416.693014:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442048 00000100:00100000:1.0:1788305416.693088:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305416.693100:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+9:14411:x1875173761442048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305416.693116:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305416.693296:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae9551 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.693325:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.693355:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.693365:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f400, rc 0) 00000100:00100000:1.0:1788305416.693479:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+10:14411:x1875173761442048:12345-0@lo:101:mount.lustre.0 Request processed in 380us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.693486:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305416.696738:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305416.696769:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.696781:0:14411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305416.697547:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442176:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788305416.697630:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.697678:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82f4c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.698004:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442176 00000100:00100000:1.0:1788305416.698012:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442176 00000100:00100000:1.0:1788305416.698087:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305416.698098:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+10:14411:x1875173761442176:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788305416.698120:0:14423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788305416.698137:0:14423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788305416.698228:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+10:14411:x1875173761442176:12345-0@lo:256:mount.lustre.0 Request processed in 131us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.698236:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305416.698385:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442176:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788305416.699463:0:14411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305416.699487:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.699499:0:14411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305416.699508:0:14411:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb9972000 from 1 10000000:01000000:2.0:1788305416.699510:0:14411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305416.699548:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.699555:0:14411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.699565:0:14411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305416.699644:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305416.699695:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305416.699725:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb98580c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305416.699889:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442304 00000100:00100000:0.0:1788305416.699896:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442304 00000100:00100000:0.0:1788305416.699945:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305416.699954:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+10:14411:x1875173761442304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305416.699965:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305416.699979:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae955f expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.699999:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae955f expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.700009:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae955f expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.700017:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf800, rc 0) 00000100:00100000:0.0:1788305416.700050:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761442304:12345-0@lo:101:mount.lustre.0 Request processed in 96us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305416.700083:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305416.700300:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305416.700313:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.700322:0:14411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305416.700372:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305416.700395:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305416.700424:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb98580c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.700466:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442432 00000100:00100000:1.0:1788305416.700470:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442432 00000100:00100000:1.0:1788305416.700500:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305416.700506:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761442432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305416.700987:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761442432:12345-0@lo:501:mount.lustre.0 Request processed in 479us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.700995:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305416.701260:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305416.701293:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305416.701334:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305416.701365:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb98580c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.701417:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442560 00000100:00100000:1.0:1788305416.701423:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442560 00000100:00100000:1.0:1788305416.701456:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305416.701471:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761442560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305416.701624:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761442560:12345-0@lo:503:mount.lustre.0 Request processed in 154us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.701631:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305416.701986:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305416.706467:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14455:1875173761442688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305416.706561:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305416.706623:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb88e64c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305416.706737:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442688 00000100:00100000:2.0:1788305416.706758:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442688 00000100:00100000:2.0:1788305416.706809:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305416.706818:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14455:x1875173761442688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305416.707108:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14455:x1875173761442688:12345-0@lo:502:llog_process_th.0 Request processed in 291us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305416.707137:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305416.707359:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14455:1875173761442688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305416.707391:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305416.707402:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305416.707405:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788305416.707414:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbb9972000 00000020:00000080:0.0:1788305416.707417:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305416.707426:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305416.707428:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305416.707430:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788305416.707433:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305416.707435:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305416.707437:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788305416.707440:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbb9972000 00000020:00000080:0.0:1788305416.707442:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305416.707507:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305416.707511:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305416.707512:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788305416.707515:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305416.707517:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305416.707519:0:14455:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305416.707522:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96fbb9972000 00000020:00000080:0.0:1788305416.707525:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788305416.707566:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14455:1875173761442816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305416.707622:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.707658:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82f4c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.707716:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442816 00000100:00100000:1.0:1788305416.707722:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442816 00000100:00100000:1.0:1788305416.707769:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305416.707778:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14455:x1875173761442816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305416.707927:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14455:x1875173761442816:12345-0@lo:502:llog_process_th.0 Request processed in 150us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.707936:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305416.708163:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14455:1875173761442816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305416.708183:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305416.708188:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305416.708189:0:14455:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788305416.708194:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788305416.708618:0:14411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788305416.708644:0:14411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305416.708670:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.708683:0:14411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305416.708749:0:14411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788305416.708753:0:14411:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96fbb9972000 10000000:01000000:0.0:1788305416.708757:0:14411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96fbb9972000 10000000:01000000:0.0:1788305416.708761:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305416.708768:0:14411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fbb9972000 from 1 10000000:01000000:0.0:1788305416.708770:0:14411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305416.708800:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.708809:0:14411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.708819:0:14411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305416.708835:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305416.708874:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.708907:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90e6c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.709029:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761442944 00000100:00100000:1.0:1788305416.709035:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761442944 00000100:00100000:1.0:1788305416.709094:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305416.709103:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761442944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305416.709114:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305416.709138:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae9574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae956d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.709160:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae9574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae956d expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.709170:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071e600/0x902a3611c9ae9574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae956d expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.709190:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e600, rc 0) 00000100:00100000:1.0:1788305416.709224:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14411:x1875173761442944:12345-0@lo:101:mount.lustre.0 Request processed in 123us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.709231:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305416.709394:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761442944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305416.709409:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9574 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.709418:0:14411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9574 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305416.709464:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761443072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305416.709493:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.709531:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90e6c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305416.709610:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443072 00000100:00100000:3.0:1788305416.709615:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443072 00000100:00100000:3.0:1788305416.709649:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305416.709657:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14411:x1875173761443072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305416.710298:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14411:x1875173761443072:12345-0@lo:501:mount.lustre.0 Request processed in 639us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.710306:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305416.710642:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761443072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305416.710681:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761443200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305416.710722:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.710774:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90e6c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.711168:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443200 00000100:00100000:1.0:1788305416.711176:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443200 00000100:00100000:1.0:1788305416.711217:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305416.711226:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14411:x1875173761443200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305416.711407:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14411:x1875173761443200:12345-0@lo:503:mount.lustre.0 Request processed in 181us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305416.711415:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305416.711570:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761443200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305416.712200:0:14456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14456:1875173761443328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305416.712247:0:14456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.712277:0:14456:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90e6ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305416.712430:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443328 00000100:00100000:3.0:1788305416.712436:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443328 00000100:00100000:3.0:1788305416.712475:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788305416.712483:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14456:x1875173761443328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305416.712700:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14456:x1875173761443328:12345-0@lo:502:llog_process_th.0 Request processed in 216us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.712707:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788305416.713095:0:14456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14456:1875173761443328:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788305416.716363:0:14456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788305416.716381:0:14456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff96fa818c3370) 00000020:00000080:0.0:1788305416.716400:0:14456:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788305416.716482:0:14456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbb9972000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788305416.716486:0:14456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fbb9972000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788305416.716489:0:14456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fbb9972000 4 00010000:00080000:0.0:1788305416.716516:0:14456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fbc16b4000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788305416.720030:0:14456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788305416.720944:0:14456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788305416.720980:0:14456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788305416.720994:0:14456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x902a3611c9ae9582 00000100:00080000:0.0:1788305416.721005:0:14456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305416.721010:0:14456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96fbc16b4000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788305416.721075:0:14456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf27ad80 x1875173761443456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305416.721099:0:14456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305416.721507:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761443456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788305416.721576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305416.721628:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443456 00000100:00100000:1.0:1788305416.721636:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443456 00000100:00100000:1.0:1788305416.721675:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305416.721684:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875173761443456:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788305416.722146:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305416.722154:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc16b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305416.723022:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788305416.723028:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761443456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305416.728864:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875173761443456:12345-0@lo:38:llog_process_th.0 Request processed in 56us (163us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788305416.728881:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305416.731263:0:14456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14456:1875173761443584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305416.731346:0:14456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305416.731389:0:14456:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90e6c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305416.731410:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443584 00000100:00100000:0.0:1788305416.731416:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443584 00000100:00100000:0.0:1788305416.731461:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305416.731470:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14456:x1875173761443584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305416.731723:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14456:x1875173761443584:12345-0@lo:502:llog_process_th.0 Request processed in 253us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305416.731731:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305416.735082:0:14456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14456:1875173761443584:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788305416.735130:0:14456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788305416.736521:0:14411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788305416.736553:0:14411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305416.736572:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9574 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305416.736599:0:14411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb870bfc00/0x902a3611c9ae956d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9574 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305416.736672:0:14411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305416.736675:0:14411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305416.736676:0:14411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305416.736677:0:14411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305416.736679:0:14411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305416.736680:0:14411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305416.736681:0:14411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305416.736683:0:14411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305416.736685:0:14411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305416.736687:0:14411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305416.736690:0:14411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788305416.736692:0:14411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305416.736693:0:14411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305416.736695:0:14411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305416.736696:0:14411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305416.736697:0:14411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305416.736698:0:14411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305416.736698:0:14411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305416.736699:0:14411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305416.736700:0:14411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305416.736701:0:14411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305416.736726:0:14411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788305416.736757:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761443712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305416.736842:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305416.736881:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb852c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305416.736922:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443712 00000100:00100000:1.0:1788305416.736929:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443712 00000100:00100000:1.0:1788305416.736976:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305416.736985:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14411:x1875173761443712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788305416.737010:0:14422:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788305416.737026:0:14422:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788305416.846209:0:14422:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788305416.846225:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788305416.846253:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305416.846299:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305416.846328:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.846349:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.846359:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.846415:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.846430:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 12 pid: 14424 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305416.846444:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875173761443840:0@lo:104: 00000100:00100000:2.0:1788305416.846510:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305416.846558:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb853fea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305416.846569:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443840 00000100:00100000:3.0:1788305416.846576:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443840 00000100:00100000:3.0:1788305416.846640:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305416.846650:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14445:x1875173761443840:12345-0@lo:104: 00010000:00010000:3.0:1788305416.846664:0:14412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.846724:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305416.846731:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14445:x1875173761443840:12345-0@lo:104: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.846738:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305416.846776:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875173761443840:0@lo:104: 00010000:00010000:2.0:1788305416.846794:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.847350:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305416.847359:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.847368:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:0.0:1788305416.847372:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.847381:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305416.847388:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305416.847394:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305416.847433:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.847452:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788305416.847518:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761443968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305416.847558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305416.847627:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305416.847636:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb870bea00/0x902a3611c9ae9551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9558 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.847666:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761443968 00000100:00100000:3.0:1788305416.847672:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761443968 00010000:00010000:0.0:1788305416.847687:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305416.847689:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305416.847691:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305416.847693:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 13 pid: 14424 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.847724:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305416.847732:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+13:3301:x1875173761443968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305416.847743:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305416.847748:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 13 pid: 14424 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847770:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 13 pid: 14424 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847783:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071f400/0x902a3611c9ae9558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae9551 expref: 13 pid: 14424 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847802:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847810:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788305416.847823:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001565792s 00010000:00010000:3.0:1788305416.847827:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847834:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847841:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847847:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847852:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305416.847857:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847864:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847880:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305416.847889:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305416.847923:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:3301:x1875173761443968:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.847930:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305416.847962:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761443968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305416.847984:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.847993:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305416.848000:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc2045400/0x902a3611c9ae9589 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305416.851517:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14411:x1875173761443712:12345-0@lo:253:mount.lustre.0 Request processed in 114524us (114668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305416.851531:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305416.851534:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14411:1875173761443712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788305416.851566:0:14411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788305416.851593:0:14411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305416.851595:0:14411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305416.851596:0:14411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305416.851597:0:14411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305416.851598:0:14411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305416.851599:0:14411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305416.851601:0:14411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305416.851602:0:14411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305416.851604:0:14411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305416.851606:0:14411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788305416.851620:0:14411:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788305416.856045:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788305416.856234:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788305416.856514:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788305416.856683:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788305416.856926:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788305416.857361:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788305416.858097:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788305416.858265:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788305416.858475:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788305416.858700:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788305416.858938:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788305416.859209:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788305416.898481:0:14411:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788305416.900117:0:14411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788305416.900571:0:14468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788305416.900689:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305416.905329:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788305416.905448:0:14468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788305416.905453:0:14468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1788305416.906133:0:14467:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788305416.906138:0:14467:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788305416.915291:0:14411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788305416.915514:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788305416.918243:0:14411:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788305416.918267:0:14411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788305416.920213:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305416.928786:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788305416.930021:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788305416.930088:0:14411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788305416.936537:0:14411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788305416.946414:0:14411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788305416.980472:0:14411:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788305416.980512:0:14411:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb81141a23988 00100000:10000000:0.0:1788305416.980521:0:14411:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788305416.983149:0:14411:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788305416.983167:0:14411:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788305416.983186:0:14411:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788305416.983206:0:14411:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788305417.330147:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305417.778218:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788305417.971991:0:14426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788305417.971999:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fbb9972000 from 6 10000000:01000000:2.0:1788305417.972005:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305417.972070:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305417.972085:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305417.972098:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305417.972125:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761444096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305417.972233:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305417.972277:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305417.972408:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444096 00000100:00100000:0.0:1788305417.972425:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444096 00000100:00100000:0.0:1788305417.972483:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305417.972492:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14426:x1875173761444096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305417.972505:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305417.972518:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae9590 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305417.972542:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305417.972554:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305417.972574:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bea00, rc 0) 00000100:00100000:0.0:1788305417.972620:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761444096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305417.972626:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305417.972673:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761444096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305417.972686:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305417.972693:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305417.972741:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761444224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788305417.972771:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305417.972787:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305417.972802:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444224 00000100:00100000:0.0:1788305417.972811:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444224 00000100:00100000:0.0:1788305417.972834:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305417.972840:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761444224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788305417.972866:0:14422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788305417.972882:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788305417.972885:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788305417.972970:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761444224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305417.972977:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305417.973005:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761444224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788305417.973046:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305417.973085:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305417.973093:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305418.361571:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305418.802748:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305419.377261:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305420.410903:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305421.426226:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305421.864583:0:14710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788305422.070954:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305422.070962:0:12627:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305422.070975:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305422.070978:0:12627:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305422.070980:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788305422.070983:0:12627:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305422.070987:0:12627:0:(import.c:65:import_set_state_nolock()) ffff96fbc16b4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305422.071000:0:12627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96fbc16b4000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305422.071025:0:12627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf58df80 x1875173761444480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305422.071075:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305422.071092:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761444352:0@lo:400:kworker.0 00000100:00100000:1.0:1788305422.071167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305422.071239:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444352 00000100:00100000:1.0:1788305422.071247:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444352 00000100:00100000:1.0:1788305422.071302:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305422.071313:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:3301:x1875173761444352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305422.071363:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:3301:x1875173761444352:12345-0@lo:400:kworker.0 Request processed in 51us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305422.071371:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305422.071408:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761444480:0@lo:38:kworker.0 00000100:00100000:1.0:1788305422.071439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305422.071851:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761444352:0@lo:400:kworker.0 00000100:00100000:0.0:1788305422.072827:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444480 00000100:00100000:0.0:1788305422.072836:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444480 00000100:00100000:0.0:1788305422.072868:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305422.072873:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1875173761444480:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788305422.072896:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1788305422.072930:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x902a3611c9ae959e 00000004:00100000:0.0:1788305422.072944:0:14431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305422.073081:0:14431:0:(import.c:65:import_set_state_nolock()) ffff96fba07ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305422.073156:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875173761444480:12345-0@lo:38:kworker.0 Request processed in 281us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305422.073163:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788305422.074506:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96fbaf58df80 x1875173761444480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305422.074526:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788305422.074541:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788305422.074546:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788305422.074550:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fbc16b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305422.074557:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875173761444480:0@lo:38:kworker.0 00010000:00010000:1.0:1788305422.450229:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.474566:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305424.499188:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305424.887249:0:14861:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd66667a60 20000000:00000080:1.0:1788305424.887269:0:14861:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fbc0bef000 uarg=0000000000000000 20000000:01000000:1.0:1788305424.887556:0:14861:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788305424.887565:0:14861:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788305424.887570:0:14861:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788305424.888672:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788305424.888837:0:14861:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788305424.898230:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788305424.898324:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.898344:0:14861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae955f expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.898352:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.898453:0:14861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae955f expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.898469:0:14861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae955f expref: 11 pid: 14422 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305424.898485:0:14861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14861:1875173761444608:0@lo:104: 00000100:00100000:0.0:1788305424.898555:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305424.898612:0:14861:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb87feb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305424.898789:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444608 00000100:00100000:1.0:1788305424.898797:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444608 00000100:00100000:1.0:1788305424.898861:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305424.898872:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14861:x1875173761444608:12345-0@lo:104: 00010000:00010000:1.0:1788305424.898886:0:14412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.898963:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305424.898969:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14861:x1875173761444608:12345-0@lo:104: Request processed in 100us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305424.898976:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788305424.898997:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305424.899003:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899011:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2044800 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305424.899027:0:14417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899035:0:14417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305424.899041:0:14417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305424.899046:0:14417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305424.899110:0:14417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899116:0:14417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305424.899137:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899144:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc2044800/0x902a3611c9ae955f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899162:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305424.899164:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305424.899166:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305424.899402:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3303:1875173761444736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305424.899437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305424.899504:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444736 00000100:00100000:1.0:1788305424.899509:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444736 00010000:00010000:1.0:1788305424.899529:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae955f expref: 12 pid: 14422 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305424.899551:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305424.899565:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:3303:x1875173761444736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305424.899576:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305424.899581:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae955f expref: 12 pid: 14422 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899591:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae955f expref: 12 pid: 14422 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899607:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899615:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899626:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899634:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899641:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899647:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899652:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305424.899880:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899890:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899906:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305424.899916:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305424.900100:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb870bf800/0x902a3611c9ae9566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae955f expref: 12 pid: 14422 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305424.900113:0:14861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14861:1875173761444608:0@lo:104: 00010000:00010000:0.0:1788305424.900132:0:14861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.900141:0:14861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.900158:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305424.900164:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb870be200/0x902a3611c9ae95a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305424.901088:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:3303:x1875173761444736:12345-0@lo:103:ldlm_bl.0 Request processed in 1518us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305424.901098:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305424.901779:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3303:1875173761444736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305425.523163:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305426.165223:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305416/real 1788305416] req@ffff96fb90f5c000 x1875173761441792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305426.165257:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fb90f5c000 x1875173761441792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305426.165292:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305416/real 1788305416] req@ffff96fbaf58f480 x1875173761441664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305426.165304:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fbaf58f480 x1875173761441664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305426.165321:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305426.165347:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788305426.165351:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761441792:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788305426.165357:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fb98318800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305426.165361:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788305426.165363:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761441664:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788305426.168353:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305426.168360:0:12627:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788305426.168365:0:12627:0:(import.c:65:import_set_state_nolock()) ffff96fb98318800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305426.168374:0:12627:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1788305426.168380:0:12627:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305426.168386:0:12627:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96fb98318800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788305426.168411:0:12627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fa83232a00 x1875173761444992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305426.168440:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305426.168444:0:12627:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788305426.168446:0:12627:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305426.168449:0:12627:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1788305426.168452:0:12627:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305426.168456:0:12627:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96fba0333000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1788305426.168803:0:12627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fa83231880 x1875173761445120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305426.168845:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305426.168860:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3303:1875173761444864:0@lo:400:kworker.0 00000100:00100000:2.0:1788305426.168925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305426.168975:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761445248:0@lo:400:kworker.0 00000100:00100000:2.0:1788305426.169006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305426.169041:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761444864 00000100:00100000:2.0:1788305426.169047:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761444864 00000100:00100000:2.0:1788305426.169129:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305426.169137:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:3303:x1875173761444864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305426.169184:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:3303:x1875173761444864:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305426.169191:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305426.169223:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761445248 00000100:00100000:2.0:1788305426.169226:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761445248 00000100:00100000:2.0:1788305426.169257:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305426.169264:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761445248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305426.169300:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761445248:12345-0@lo:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305426.169305:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305426.169338:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3303:1875173761444864:0@lo:400:kworker.0 00010000:00080000:2.0:1788305426.169364:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96fa83233b80 x1875173761445248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305426.169374:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761445248:0@lo:400:kworker.0 00000100:00100000:1.0:1788305426.169743:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761444992:0@lo:8:kworker.0 00000400:00000100:1.0:1788305426.169774:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875173761444992 offset 0 length 520: 4 00000100:00100000:1.0:1788305426.169806:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761445120:0@lo:8:kworker.0 00000400:00000100:1.0:1788305426.169827:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875173761445120 offset 0 length 520: 4 10000000:01000000:3.0:1788305426.433121:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305426.433128:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb9972000 from 10 10000000:01000000:3.0:1788305426.433132:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305426.433181:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305426.433193:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305426.433205:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305426.433231:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761445376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305426.433304:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305426.433361:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305426.433451:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761445376 00000100:00100000:2.0:1788305426.433640:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761445376 00000100:00100000:2.0:1788305426.433700:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305426.433712:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+11:14426:x1875173761445376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305426.433726:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305426.433741:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae95ac expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305426.433764:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305426.433790:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305426.433799:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045c00, rc 0) 00000100:00100000:2.0:1788305426.433851:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761445376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305426.433858:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305426.435803:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761445376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305426.435829:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305426.435840:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305426.435917:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761445504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305426.435969:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305426.436001:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305426.436176:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761445504 00000100:00100000:2.0:1788305426.436183:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761445504 00000100:00100000:2.0:1788305426.436228:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305426.436237:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761445504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305426.436756:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761445504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 518us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305426.436764:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788305426.437773:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761445504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305426.437827:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761445632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305426.437886:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305426.437927:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305426.438388:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761445632 00000100:00100000:0.0:1788305426.438395:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761445632 00000100:00100000:0.0:1788305426.438443:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305426.438452:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761445632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305426.438654:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:14426:x1875173761445632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305426.438662:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305426.438748:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761445632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788305426.440002:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788305426.440194:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788305426.440215:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305426.440225:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305426.440236:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305426.550432:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305427.570972:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305428.019778:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305428.593460:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305429.618458:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305430.642760:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788305431.260170:0:15111:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788305431.260175:0:15111:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788305431.260314:0:15111:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96fbc16b4800 00000020:01000004:0.0:1788305431.261656:0:15111:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788305431.261674:0:15111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788305431.261691:0:15111:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96fa818c4d28) 00000020:00000080:0.0:1788305431.261712:0:15111:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00000100:00080000:3.0:1788305431.281352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305431.281360:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305431.281375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305431.281378:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788305431.281410:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305431.281426:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761445888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305431.281488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.281625:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305431.281634:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761445760:0@lo:400:kworker.0 00000100:00100000:0.0:1788305431.281666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.281695:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761445760 00000100:00100000:0.0:1788305431.281701:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761445760 00000100:00100000:0.0:1788305431.281737:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305431.281745:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:3301:x1875173761445760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305431.281794:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:3301:x1875173761445760:12345-0@lo:400:kworker.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305431.281801:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305431.281841:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761445760:0@lo:400:kworker.0 00000100:00100000:3.0:1788305431.281937:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761445888 00000100:00100000:3.0:1788305431.281941:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761445888 00000100:00100000:3.0:1788305431.281973:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305431.281979:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761445888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305431.282019:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761445888:12345-0@lo:400:kworker.0 Request processed in 41us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305431.282025:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788305431.282142:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96fb90f5ca80 x1875173761445888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305431.282154:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761445888:0@lo:400:kworker.0 00100000:10000000:0.0:1788305431.310088:0:15111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788305431.310375:0:15111:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788305431.311104:0:15111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788305431.311365:0:15111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788305431.311570:0:15111:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788305431.311947:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 453: rc = 0 00100000:10000000:0.0:1788305431.312035:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 453: rc = 0 00100000:10000000:0.0:1788305431.312170:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 453: rc = 0 00100000:10000000:0.0:1788305431.314833:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 20: rc = 0 00100000:10000000:0.0:1788305431.315711:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 20: rc = 0 00100000:10000000:0.0:1788305431.315988:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 20: rc = 0 00100000:10000000:0.0:1788305431.316929:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 20: rc = 0 00100000:10000000:0.0:1788305431.317895:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 20: rc = 0 00100000:10000000:0.0:1788305431.318858:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 20: rc = 0 00000020:00000080:0.0:1788305431.319760:0:15111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788305431.319772:0:15111:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305431.319785:0:15111:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x902a3611c9ae95c1 00000020:01000004:0.0:1788305431.319801:0:15111:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788305431.319823:0:15111:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788305431.319827:0:15111:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788305431.319833:0:15111:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788305431.319838:0:15111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788305431.319850:0:15111:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96fa818c0000) 00000020:00000080:0.0:1788305431.319861:0:15111:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788305431.321043:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305431.321235:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788305431.321242:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788305431.325910:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788305431.325923:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788305431.326319:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788305431.326326:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788305431.331218:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305431.331411:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788305431.331417:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788305431.339080:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788305431.339093:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788305431.371917:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305431.372814:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305431.372823:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788305431.380362:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305431.380382:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788305431.392737:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788305431.395758:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788305431.409435:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305431.409714:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788305431.409722:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788305431.410420:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305431.410427:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788305431.480759:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305431.480970:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788305431.480977:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788305431.488637:0:15111:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305431.495211:0:15111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788305431.495880:0:15111:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788305431.495907:0:15111:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788305431.495913:0:15111:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788305431.510204:0:15111:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788305431.510257:0:15111:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788305431.510261:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788305431.510263:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305431.510264:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305431.510265:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305431.510266:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305431.510268:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305431.510269:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305431.510271:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305431.510272:0:15111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305431.510276:0:15111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788305431.510278:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305431.510279:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305431.510280:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305431.510281:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305431.510282:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305431.510283:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305431.510284:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305431.510285:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305431.510287:0:15111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305431.510314:0:15111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788305431.510348:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788305431.510430:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.510494:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.510661:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446016 00000100:00100000:2.0:1788305431.510669:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446016 00000100:00100000:2.0:1788305431.510725:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305431.510744:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:15111:x1875173761446016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305431.510777:0:14422:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788305431.510780:0:14422:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788305431.510784:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788305431.531346:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:15111:x1875173761446016:12345-0@lo:253:mount.lustre.0 Request processed in 20596us (20907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.531362:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305431.534746:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305431.534769:0:15111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788305431.534772:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305431.534774:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305431.534775:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305431.534777:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305431.534778:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305431.534779:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305431.534781:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305431.534783:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305431.534785:0:15111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788305431.534840:0:15111:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96fbc16b4800 from lustre-OST0000 10000000:01000000:0.0:1788305431.534865:0:15111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788305431.534867:0:15111:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788305431.534874:0:15111:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96fb8502cd28 local copy 00010000:00010000:0.0:1788305431.534883:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305431.535161:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305431.535225:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.535350:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.536677:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446144 00000100:00100000:2.0:1788305431.536687:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446144 00000100:00100000:2.0:1788305431.536734:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305431.536745:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:15111:x1875173761446144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305431.537082:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:15111:x1875173761446144:12345-0@lo:501:mount.lustre.0 Request processed in 308us (1825us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305431.537090:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305431.540763:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446144:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788305431.540889:0:15111:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788305431.541170:0:15111:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788305431.541183:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.541194:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305431.541223:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96fbc16b4800 10000000:01000000:2.0:1788305431.541228:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305431.541233:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96fb8502cd28 10000000:01000000:2.0:1788305431.541235:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788305431.541238:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96fb8502cd28 from 1 10000000:01000000:2.0:1788305431.541242:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788305431.541277:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.541286:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.541305:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305431.541334:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305431.541399:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305431.541503:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.543271:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446272 00000100:00100000:1.0:1788305431.543285:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446272 00000100:00100000:1.0:1788305431.543416:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305431.543429:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+12:15111:x1875173761446272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305431.543444:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305431.543463:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb9071f600/0x902a3611c9ae95d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae95cf expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.543517:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071f600/0x902a3611c9ae95d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae95cf expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.543528:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb9071f600/0x902a3611c9ae95d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae95cf expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.543538:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f600, rc 0) 00000100:00100000:1.0:1788305431.543635:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+13:15111:x1875173761446272:12345-0@lo:101:mount.lustre.0 Request processed in 209us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.543653:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305431.543748:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305431.543765:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95d6 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305431.543774:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae95d6 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305431.543792:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788305431.543817:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95d6 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305431.543824:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc2045400/0x902a3611c9ae95cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95d6 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305431.543831:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788305431.543836:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305431.543842:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788305431.543844:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788305431.543869:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305431.543877:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305431.543886:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305431.543903:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305431.543937:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305431.551773:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446400 00000100:00100000:2.0:1788305431.551788:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446400 00000100:00100000:2.0:1788305431.551842:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788305431.551852:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+13:15111:x1875173761446400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305431.551869:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305431.551887:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc2044600/0x902a3611c9ae95e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae95dd expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.551914:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2044600/0x902a3611c9ae95e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae95dd expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.551924:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc2044600/0x902a3611c9ae95e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae95dd expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.551933:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044600, rc 0) 00000100:00100000:2.0:1788305431.551991:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446400:12345-0@lo:101:mount.lustre.0 Request processed in 141us (8053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.551997:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305431.552177:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb6149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305431.552200:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305431.552217:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95e4 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305431.552225:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae95e4 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305431.552926:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788305431.553798:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305431.554039:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788305431.554144:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788305431.554178:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788305431.554228:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788305431.554265:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788305431.554299:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788305431.554379:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788305431.554387:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788305431.554461:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305431.554522:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.554543:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.554708:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446528 00000100:00100000:1.0:1788305431.554715:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446528 00000100:00100000:1.0:1788305431.554753:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788305431.554762:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305431.555090:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446528:12345-0@lo:501:mount.lustre.0 Request processed in 328us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.555098:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305431.556769:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305431.556825:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305431.556891:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.556970:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.560193:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446656 00000100:00100000:1.0:1788305431.560207:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446656 00000100:00100000:1.0:1788305431.560306:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305431.560317:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305431.560880:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446656:12345-0@lo:503:mount.lustre.0 Request processed in 563us (3987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.560890:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305431.564874:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788305431.565508:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305431.565705:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305431.565786:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.565888:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.565966:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446784 00000100:00100000:1.0:1788305431.565974:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446784 00000100:00100000:1.0:1788305431.566023:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305431.566034:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305431.566292:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446784:12345-0@lo:502:mount.lustre.0 Request processed in 259us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.566300:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305431.566463:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305431.566793:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788305431.566845:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788305431.566880:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788305431.566934:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788305431.566969:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788305431.567020:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788305431.567097:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788305431.567133:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788305431.567164:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788305431.567213:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788305431.567249:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788305431.567296:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788305431.567348:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305431.567407:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.567448:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb614d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.568671:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761446912 00000100:00100000:1.0:1788305431.568682:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761446912 00000100:00100000:1.0:1788305431.568788:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305431.568798:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305431.569038:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761446912:12345-0@lo:502:mount.lustre.0 Request processed in 241us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.569046:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305431.569183:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761446912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305431.569285:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788305431.569299:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788305431.572833:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305431.572845:0:15125:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788305431.572852:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305431.572861:0:15125:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788305431.572869:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305431.572886:0:15125:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96fbaf4ecd28) 00000020:00000080:2.0:1788305431.572907:0:15125:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788305431.572913:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305431.572981:0:15125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbc16b4800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788305431.572988:0:15125:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305431.572997:0:15125:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x902a3611c9ae95f2 00010000:00010000:2.0:1788305431.581795:0:15125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788305431.582815:0:15125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788305431.587951:0:15125:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788305431.596363:0:15125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788305431.596378:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305431.596385:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305431.596387:0:15125:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788305431.596392:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788305431.596395:0:15125:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788305431.596397:0:15125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305431.596398:0:15125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305431.596400:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788305431.596402:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305431.596404:0:15125:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788305431.596406:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305431.596409:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305431.596410:0:15125:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305431.596413:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305431.596415:0:15125:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788305431.596418:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305431.596420:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305431.596421:0:15125:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788305431.596424:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305431.596426:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305431.596427:0:15125:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305431.596431:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788305431.596501:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305431.596505:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305431.596507:0:15125:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305431.596510:0:15125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788305431.600700:0:15111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788305431.600742:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788305431.600783:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95e4 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.600795:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb870bec00/0x902a3611c9ae95dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae95e4 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305431.600803:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbc16b4800 from 1 10000000:01000000:3.0:1788305431.600806:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305431.600846:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.600854:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.600865:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305431.600889:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305431.600957:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305431.600996:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb4109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.601089:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447040 00000100:00100000:2.0:1788305431.601096:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447040 00000100:00100000:2.0:1788305431.601140:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788305431.601149:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+14:15111:x1875173761447040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305431.601161:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305431.601173:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae95f9 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.601196:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.601206:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.601214:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044e00, rc 0) 00000100:00100000:2.0:1788305431.601250:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447040:12345-0@lo:101:mount.lustre.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.601256:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305431.604604:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305431.604636:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.604649:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305431.605228:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788305431.607969:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305431.608402:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788305431.608456:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788305431.608522:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788305431.608531:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788305431.609360:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305431.609431:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305431.609651:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb4109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.618700:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447168 00000100:00100000:1.0:1788305431.618715:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447168 00000100:00100000:1.0:1788305431.619773:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305431.619800:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305431.620090:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447168:12345-0@lo:501:mount.lustre.0 Request processed in 293us (10658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.620098:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305431.620253:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305431.620299:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305431.620355:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305431.626829:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb4109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.629653:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447296 00000100:00100000:2.0:1788305431.629669:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447296 00000100:00100000:2.0:1788305431.629747:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305431.629756:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305431.630086:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447296:12345-0@lo:503:mount.lustre.0 Request processed in 330us (9729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.630094:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305431.632753:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305431.633357:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305431.633453:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305431.633533:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305431.633750:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb4109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.633798:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447424 00000100:00100000:2.0:1788305431.633804:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447424 00000100:00100000:2.0:1788305431.633844:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305431.633853:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305431.634039:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447424:12345-0@lo:502:mount.lustre.0 Request processed in 186us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.634048:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305431.634170:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305431.634424:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788305431.634476:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788305431.634528:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788305431.634823:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788305431.634856:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788305431.634899:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788305431.634927:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788305431.634952:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788305431.634981:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305431.635029:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305431.635146:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbbb4109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305431.636721:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447552 00000100:00100000:0.0:1788305431.636735:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447552 00000100:00100000:0.0:1788305431.644706:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788305431.644734:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305431.645025:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447552:12345-0@lo:502:mount.lustre.0 Request processed in 305us (9994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305431.645034:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788305431.645134:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305431.645293:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788305431.645308:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788305431.649355:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305431.649369:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305431.649371:0:15129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788305431.649379:0:15129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbc16b4800 00000020:00000080:0.0:1788305431.649381:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305431.649402:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305431.649405:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305431.649406:0:15129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788305431.649409:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305431.649411:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305431.649413:0:15129:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788305431.649416:0:15129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbc16b4800 00000020:00000080:0.0:1788305431.649418:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305431.649498:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305431.649502:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305431.649504:0:15129:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788305431.649506:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305431.649509:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305431.649510:0:15129:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305431.649514:0:15129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96fbc16b4800 00000020:00000080:0.0:1788305431.649516:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305431.651703:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305431.651714:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305431.651717:0:15129:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788305431.651721:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788305431.652038:0:15111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788305431.652088:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305431.652109:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.652120:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305431.652163:0:15111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788305431.652166:0:15111:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96fbc16b4800 10000000:01000000:1.0:1788305431.652169:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96fbc16b4800 10000000:01000000:1.0:1788305431.652174:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305431.652180:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fbc16b4800 from 1 10000000:01000000:1.0:1788305431.652182:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305431.652221:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.652229:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.652241:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305431.652265:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305431.652346:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.652400:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460780 going to sleep for 11 seconds 00000100:00100000:3.0:1788305431.660155:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447680 00000100:00100000:3.0:1788305431.660169:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447680 00000100:00100000:3.0:1788305431.660227:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305431.660237:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761447680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305431.660253:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305431.660269:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbb9dbc800/0x902a3611c9ae960e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae9607 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.660296:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbb9dbc800/0x902a3611c9ae960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae9607 expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.660307:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbb9dbc800/0x902a3611c9ae960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9607 expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305431.660316:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc800, rc 0) 00000100:00100000:3.0:1788305431.660413:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761447680:12345-0@lo:101:mount.lustre.0 Request processed in 177us (8066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305431.660420:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788305431.660531:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305431.661651:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae960e expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.661666:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae960e expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305431.662314:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788305431.663038:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305431.663347:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788305431.663393:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788305431.663429:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788305431.663479:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788305431.663514:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788305431.663576:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788305431.663616:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788305431.663650:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788305431.663701:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788305431.663739:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788305431.663775:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788305431.663861:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788305431.663899:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788305431.663932:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788305431.663997:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788305431.664036:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788305431.664101:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788305431.664152:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788305431.664190:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788305431.664226:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788305431.664288:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788305431.664337:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788305431.664385:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788305431.664435:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788305431.664473:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788305431.664502:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788305431.664543:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788305431.664601:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788305431.664675:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788305431.664683:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788305431.664771:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305431.664832:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.664875:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.664906:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447808 00000100:00100000:1.0:1788305431.664912:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447808 00000100:00100000:1.0:1788305431.664952:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305431.664961:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761447808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305431.665186:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761447808:12345-0@lo:501:mount.lustre.0 Request processed in 225us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.665194:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305431.665237:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305431.665264:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305431.665299:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.665311:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0460780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.665338:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761447936 00000100:00100000:1.0:1788305431.665342:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761447936 00000100:00100000:1.0:1788305431.665365:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788305431.665371:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761447936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305431.665507:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761447936:12345-0@lo:503:mount.lustre.0 Request processed in 135us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.665519:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788305431.665557:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761447936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305431.666152:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305431.666210:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761448064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305431.666246:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.666263:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82cae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305431.666280:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448064 00000100:00100000:1.0:1788305431.666284:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448064 00000100:00100000:1.0:1788305431.666306:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788305431.666312:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761448064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305431.673257:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761448064:12345-0@lo:502:mount.lustre.0 Request processed in 6935us (7000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.673272:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1788305431.674986:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305431.687916:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761448064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305431.688262:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788305431.688330:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788305431.688368:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788305431.688418:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788305431.688458:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788305431.688514:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788305431.690277:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788305431.690359:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788305431.690431:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788305431.690473:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788305431.690509:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788305431.691821:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788305431.691874:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788305431.691921:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788305431.691969:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788305431.692007:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788305431.692089:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788305431.692141:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788305431.692180:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788305431.692219:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788305431.692272:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788305431.692309:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788305431.692353:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788305431.692403:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788305431.692440:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788305431.692477:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788305431.692527:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788305431.692872:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788305431.692911:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788305431.692966:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788305431.693006:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788305431.694184:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788305431.694229:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788305431.694305:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788305431.694363:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788305431.694413:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788305431.694454:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788305431.694492:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788305431.698452:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788305431.698588:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788305431.698646:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761448192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305431.698743:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.698794:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82cae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.699512:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448192 00000100:00100000:2.0:1788305431.699521:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448192 00000100:00100000:2.0:1788305431.699704:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305431.699713:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761448192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305431.699959:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761448192:12345-0@lo:502:mount.lustre.0 Request processed in 245us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.699967:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305431.700833:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761448192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305431.700957:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788305431.700972:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788305431.706899:0:15134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788305431.706942:0:15134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96fa81aa4d28) 00000020:00000080:0.0:1788305431.706966:0:15134:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788305431.707102:0:15134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbc16b4800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788305431.707107:0:15134:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fbc16b4800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788305431.707109:0:15134:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fbc16b4800 3 00010000:00080000:0.0:1788305431.707143:0:15134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fa82777800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1788305431.708910:0:15134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788305431.709127:0:15134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788305431.709165:0:15134:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788305431.709180:0:15134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x902a3611c9ae961c 00000100:00080000:0.0:1788305431.709191:0:15134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305431.709196:0:15134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96fa82777800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788305431.709240:0:15134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf278380 x1875173761448320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305431.709299:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875173761448320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305431.709407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305431.709471:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448320 00000100:00100000:0.0:1788305431.709478:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448320 00000100:00100000:0.0:1788305431.709515:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305431.709523:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1875173761448320:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788305431.709545:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1788305431.709578:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x902a3611c9ae9623 00000004:00100000:0.0:1788305431.709593:0:14431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305431.709627:0:14431:0:(import.c:65:import_set_state_nolock()) ffff96fa82770800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305431.712606:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875173761448320:12345-0@lo:38:llog_process_th.0 Request processed in 3073us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305431.712621:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788305431.712654:0:15134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788305431.714897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305431.714906:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305431.714909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305431.714912:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305431.714988:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305431.715005:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761448448:0@lo:400:kworker.0 00000100:00100000:2.0:1788305431.715114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305431.715170:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448448 00000100:00100000:2.0:1788305431.715178:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448448 00000100:00100000:2.0:1788305431.715218:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305431.715227:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761448448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305431.715285:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761448448:12345-0@lo:400:kworker.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.715292:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788305431.715339:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fa83231500 x1875173761448448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305431.715354:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761448448:0@lo:400:kworker.0 00010000:00080000:1.0:1788305431.721585:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf278380 x1875173761448320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305431.721601:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305431.721614:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788305431.721624:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788305431.721631:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788305431.721635:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fa82777800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305431.721643:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875173761448320:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788305431.722017:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788305431.722903:0:15111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788305431.722940:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305431.722968:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae960e expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.722980:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb9071ee00/0x902a3611c9ae9607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae960e expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305431.723047:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305431.723082:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305431.723083:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305431.723085:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305431.723086:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305431.723088:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305431.723089:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305431.723092:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305431.723094:0:15111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305431.723099:0:15111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788305431.723102:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305431.723103:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305431.723112:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305431.723113:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305431.723113:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305431.723114:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305431.723115:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305431.723116:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305431.723117:0:15111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305431.723146:0:15111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788305431.723166:0:15111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761448576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305431.723256:0:15111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.723298:0:15111:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb82cae840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305431.723632:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448576 00000100:00100000:3.0:1788305431.723644:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448576 00000100:00100000:3.0:1788305431.723698:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305431.723707:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15111:x1875173761448576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788305431.723735:0:14423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788305431.723749:0:14423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788305431.763728:0:14423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788305431.763748:0:14423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788305431.763808:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788305431.763813:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788305431.763837:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.763857:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.763867:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.763910:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.763924:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 16 pid: 14423 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305431.763938:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875173761448704:0@lo:104: 00000100:00100000:1.0:1788305431.764007:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.764079:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862a4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305431.764147:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448704 00000100:00100000:2.0:1788305431.764155:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448704 00000100:00100000:2.0:1788305431.764215:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305431.764225:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14445:x1875173761448704:12345-0@lo:104: 00010000:00010000:2.0:1788305431.764238:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305431.764287:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305431.764292:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14445:x1875173761448704:12345-0@lo:104: Request processed in 70us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305431.764300:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788305431.764367:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305431.764373:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764393:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbc2045200 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305431.764397:0:14417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764406:0:14417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305431.764413:0:14417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305431.764419:0:14417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305431.764460:0:14417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764467:0:14417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305431.764487:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764493:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbc2045200/0x902a3611c9ae9590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9597 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764512:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305431.764514:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305431.764515:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305431.764526:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305431.764534:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761448832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305431.764575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305431.764611:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448832 00000100:00100000:1.0:1788305431.764615:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448832 00010000:00010000:1.0:1788305431.764640:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 17 pid: 14423 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305431.764662:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305431.764669:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:3302:x1875173761448832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305431.764693:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305431.764698:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 17 pid: 14423 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764707:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 17 pid: 14423 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764720:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764727:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305431.764739:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001565792s 00010000:00010000:1.0:1788305431.764743:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764749:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764755:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764761:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764765:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305431.764775:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764781:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764788:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764796:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305431.764822:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:3302:x1875173761448832:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305431.764828:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305431.764859:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761448832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305431.764880:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae9597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae9590 expref: 16 pid: 14423 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305431.764889:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875173761448704:0@lo:104: 00010000:00010000:1.0:1788305431.764898:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764904:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764909:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305431.764914:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb9071f000/0x902a3611c9ae962a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305431.770898:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:15111:x1875173761448576:12345-0@lo:253:mount.lustre.0 Request processed in 47184us (47635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305431.770913:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305431.771013:0:15111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15111:1875173761448576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788305431.771029:0:15111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788305431.771033:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305431.771035:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305431.771036:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305431.771037:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305431.771039:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305431.771040:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305431.771042:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305431.771044:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305431.771046:0:15111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788305431.771093:0:15111:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788305431.780338:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305431.780508:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788305431.780727:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305431.780861:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788305431.780987:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305431.781224:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788305431.788622:0:15111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788305431.874449:0:15111:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788305431.874459:0:15111:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788305431.874495:0:15111:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788305431.874688:0:15111:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788305431.874721:0:15111:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788305431.874754:0:15111:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788305432.689140:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788305433.523003:0:14426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788305433.523012:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fbb9972000 from 7 10000000:01000000:3.0:1788305433.523017:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305433.523100:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305433.523112:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305433.523125:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305433.523167:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761448960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305433.523238:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305433.523443:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb84dd29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305433.523730:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761448960 00000100:00100000:2.0:1788305433.523741:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761448960 00000100:00100000:0.0:1788305433.523901:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305433.523914:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+15:14426:x1875173761448960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305433.523930:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305433.523946:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae9631 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305433.523990:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 16 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305433.524000:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 16 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305433.524011:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be200, rc 0) 00000100:00100000:0.0:1788305433.524097:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:14426:x1875173761448960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305433.524104:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305433.524273:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761448960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305433.524320:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305433.524331:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305433.524394:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761449088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788305433.524429:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305433.524634:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305433.525664:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449088 00000100:00100000:2.0:1788305433.525677:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449088 00000100:00100000:2.0:1788305433.525727:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788305433.525738:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:14426:x1875173761449088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305433.525762:0:14424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305433.525795:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305433.525799:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788305433.525910:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:14426:x1875173761449088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305433.525919:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788305433.525966:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761449088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788305433.526038:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305433.526046:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305433.526073:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305433.715950:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305434.738793:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305435.765282:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305436.790341:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305436.915129:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305436.915137:0:12627:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305436.915139:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305436.915142:0:12627:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788305436.915194:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761449216:0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.915344:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761449344:0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.915392:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305436.915397:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761449472:0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.915445:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449216 00000100:00100000:0.0:1788305436.915465:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449216 00000100:00100000:0.0:1788305436.915513:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305436.915523:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:3302:x1875173761449216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915588:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:3302:x1875173761449216:12345-0@lo:400:kworker.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.915596:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305436.915629:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449344 00000100:00100000:0.0:1788305436.915633:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449344 00000100:00100000:0.0:1788305436.915656:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449472 00000100:00100000:0.0:1788305436.915659:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449472 00000100:00100000:0.0:1788305436.915690:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305436.915698:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761449344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915733:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761449344:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.915740:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305436.915752:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305436.915759:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761449472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915786:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761449472:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.915791:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788305436.915830:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf279180 x1875173761449472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.915843:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761449472:0@lo:400:kworker.0 00010000:00080000:0.0:1788305436.915854:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf27bb80 x1875173761449344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.915862:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761449344:0@lo:400:kworker.0 00000100:00100000:0.0:1788305436.915890:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761449216:0@lo:400:kworker.0 00000100:00080000:3.0:1788305436.916480:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305437.810179:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305438.258118:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788305438.320398:0:15478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788305438.833692:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305439.864675:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305440.882134:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.905299:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305441.970602:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305426/real 1788305426] req@ffff96fa83232a00 x1875173761444992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305441 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305441.970660:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fa83232a00 x1875173761444992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305441 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305441.970671:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305426/real 1788305426] req@ffff96fa83231880 x1875173761445120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305441 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305441.970682:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96fa83231880 x1875173761445120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305441 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788305441.970702:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fb98318800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305441.970732:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788305441.970737:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761444992:0@lo:8:kworker.0 00000100:00080000:2.0:1788305441.970742:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305441.970748:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788305441.970751:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761445120:0@lo:8:kworker.0 00000100:00080000:1.0:1788305441.970964:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305441.970969:0:12627:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788305441.970979:0:12627:0:(import.c:65:import_set_state_nolock()) ffff96fb98318800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305441.970984:0:12627:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788305441.970989:0:12627:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788305441.971006:0:12627:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96fb98318800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305441.971030:0:12627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf58df80 x1875173761449728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305441.971046:0:12627:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305441.971049:0:12627:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305441.971073:0:12627:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305441.971076:0:12627:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1788305441.971079:0:12627:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788305441.971083:0:12627:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96fba0333000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1788305441.971110:0:12627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf58d180 x1875173761449856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305441.971175:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761450112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305441.971238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305441.971312:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450112 00000100:00100000:1.0:1788305441.971319:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450112 00000100:00100000:1.0:1788305441.971382:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305441.971392:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761450112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305441.971442:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761450112:12345-0@lo:400:kworker.0 Request processed in 52us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305441.971449:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788305441.971487:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf58c380 x1875173761450112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305441.971696:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761450112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305441.971716:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761449728:0@lo:8:kworker.0 00000100:00100000:1.0:1788305441.971745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305441.971771:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761449856:0@lo:8:kworker.0 00000100:00100000:1.0:1788305441.971794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305441.971826:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449728 00000100:00100000:1.0:1788305441.971831:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449728 00000100:00100000:1.0:1788305441.971846:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449856 00000100:00100000:1.0:1788305441.971849:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449856 00000100:00100000:1.0:1788305441.971861:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305441.971867:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875173761449728:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788305441.971893:0:15112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1788305441.971921:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae963f 00002000:00100000:1.0:1788305441.971935:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96fbaf13c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788305441.971939:0:15112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788305441.971942:0:15112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788305441.974042:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761449600:0@lo:400:kworker.0 00000100:00100000:2.0:1788305441.974129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305441.974185:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305441.974192:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761449984:0@lo:400:kworker.0 00000100:00100000:2.0:1788305441.974219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305441.974258:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449600 00000100:00100000:2.0:1788305441.974265:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449600 00000100:00100000:2.0:1788305441.974304:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305441.974313:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:3301:x1875173761449600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305441.974361:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:3301:x1875173761449600:12345-0@lo:400:kworker.0 Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305441.974627:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305441.974683:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761449600:0@lo:400:kworker.0 00002000:00080000:1.0:1788305441.974861:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788305441.974893:0:15112:0:(import.c:65:import_set_state_nolock()) ffff96fbaf138000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305441.974954:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875173761449728:12345-0@lo:8:kworker.0 Request processed in 3086us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305441.974973:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305441.974991:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788305441.975552:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf58df80 x1875173761449728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305441.975564:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305441.975571:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788305441.975579:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788305441.975584:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788305441.975587:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fb98318800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788305441.975613:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788305441.975619:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761449728:0@lo:8:kworker.0 00000004:00080000:2.0:1788305441.975656:0:14451:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788305441.975946:0:14451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459685891861ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788305441.976333:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875173761449856:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788305441.976353:0:15112:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:0.0:1788305441.976527:0:14452:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788305441.976553:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875173761450368:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788305441.976614:0:14452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305441.976643:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb870e80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305441.976670:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761450240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305441.976696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305441.976752:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450240 00000100:00100000:0.0:1788305441.976758:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450240 00000100:00100000:0.0:1788305441.976802:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305441.976810:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761450240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305441.976842:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305441.976884:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875173761450240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305441.976891:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788305441.976931:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf279f80 x1875173761450240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305441.976949:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761450240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305441.977441:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875173761449856:12345-0@lo:8:kworker.0 Request processed in 2364us (5566us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305441.977452:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305441.977467:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450368 00000100:00100000:1.0:1788305441.977472:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450368 00000100:00080000:3.0:1788305441.977759:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305441.977765:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305441.978168:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761449984 00000100:00100000:0.0:1788305441.978175:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761449984 00000100:00100000:0.0:1788305441.978205:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305441.978214:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761449984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305441.978271:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875173761449984:12345-0@lo:400:kworker.0 Request processed in 59us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305441.978278:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788305441.979393:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305441.979403:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305441.979407:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761449856:0@lo:8:kworker.0 00010000:00080000:0.0:1788305441.979464:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf58ca80 x1875173761449984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305441.979477:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875173761449984:0@lo:400:kworker.0 00000100:00100000:1.0:1788305441.979552:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305441.979574:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14452:x1875173761450368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788305441.982916:0:15112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788305441.982928:0:15112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788305441.982934:0:15112:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788305441.997095:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305441.997108:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997125:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305441.997130:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305441.997137:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997169:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997179:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997187:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997219:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305441.997233:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305441.997239:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997247:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305441.997253:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997262:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997280:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997288:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047aa39d6/0x902a3611c9ae9646 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997308:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.997311:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.997314:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305441.997889:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305441.997896:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997906:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305441.997917:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305441.997921:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997930:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997938:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997946:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997960:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305441.997969:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305441.997972:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997979:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ea00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305441.997982:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997989:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.997999:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998014:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d556c057/0x902a3611c9ae964d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998026:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.998028:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.998030:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305441.998536:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305441.998543:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998552:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305441.998556:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305441.998560:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998569:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998577:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998585:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998600:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305441.998609:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305441.998618:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998625:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ec00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305441.998628:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998635:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998646:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998652:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f16259d/0x902a3611c9ae9654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.998667:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.998669:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.998671:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305441.999173:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305441.999181:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999189:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305441.999193:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305441.999198:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999220:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999230:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999237:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999250:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305441.999258:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305441.999263:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999270:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305441.999275:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999283:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999295:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999302:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000591f3e11/0x902a3611c9ae965b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999323:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.999324:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.999326:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305441.999713:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305441.999719:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999728:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305441.999732:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305441.999736:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999745:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999753:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999761:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999773:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305441.999780:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305441.999784:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999800:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305441.999803:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999811:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999822:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999829:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000d6ed23/0x902a3611c9ae9662 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305441.999841:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.999842:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305441.999844:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.002291:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.002305:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.002321:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.002326:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.002332:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.002345:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.002716:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.002728:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.002756:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305442.006614:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305442.006627:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.006641:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305442.006653:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.006665:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.006688:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.006695:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9669 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.006717:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.006718:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.006720:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.006989:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.008457:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.008479:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.008483:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.008490:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.008728:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.008740:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.008748:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.008841:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305442.010748:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.010761:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.010777:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.010782:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.010789:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.010802:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.010812:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.010822:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.011384:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305442.011393:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.011403:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fc00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305442.011408:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.011419:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.011439:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.011455:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780a07a6/0x902a3611c9ae9670 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.011719:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305442.012667:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.012676:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.012689:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.012700:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.012706:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.012719:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.012730:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.012738:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.012918:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305442.012925:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.012933:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.012937:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.012946:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.012964:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.012977:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a0193c/0x902a3611c9ae9677 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.013008:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305442.013011:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.013017:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.013020:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.013027:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.013035:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.013064:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.013067:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.013479:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.013551:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788305442.013558:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43db8f9/0x902a3611c9ae967e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.013584:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.014650:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.014661:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014673:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.014678:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.014684:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014696:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014714:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014722:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014738:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.014751:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.014757:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014764:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fe00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.014768:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014776:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014791:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014797:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9685 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.014813:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.014821:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.014823:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.017575:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.017589:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017606:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.017610:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.017617:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017631:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017642:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017649:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017677:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.017695:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.017700:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017707:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.017711:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017733:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017750:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017757:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031206f0e/0x902a3611c9ae968c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.017784:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.017786:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.017788:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.018847:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.018856:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018868:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.018872:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.018877:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018888:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018897:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018912:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018931:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.018944:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.018948:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018955:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fa00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.018959:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018968:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018980:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.018986:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6d398f/0x902a3611c9ae9693 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019097:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.019100:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.019102:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.019829:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.019845:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019857:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.019861:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.019866:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019877:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019887:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019894:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019911:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.019920:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.019924:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019932:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.019935:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019943:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019962:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019969:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae969a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.019983:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.019984:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.019986:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.024927:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.024943:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.024963:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.024968:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.024975:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.024989:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.025177:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.025610:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.025620:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.025662:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305442.026120:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305442.026127:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.026137:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.026159:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.026169:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.026187:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.026195:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.026215:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.026217:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.026219:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.029959:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.029975:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.029995:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.030096:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.030103:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.030119:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.030130:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.030139:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.030192:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305442.030226:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305442.030235:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.030245:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.030250:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.030260:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.030278:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.030295:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.030322:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.030326:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.030329:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.031796:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.031807:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.031822:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.031834:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.031840:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.031851:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.031861:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.031868:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.031889:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305442.032466:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305442.032474:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.032483:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.032488:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.032497:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.032513:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.032520:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.032541:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.032543:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.032544:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.038482:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.039311:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.039332:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.039336:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.039343:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.039357:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.039426:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.039449:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.039469:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305442.039598:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305442.039605:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.039613:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305442.039618:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.039627:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.039646:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.039653:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e82967/0x902a3611c9ae96b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.039672:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.039673:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.039675:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.043870:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.043882:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.043899:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.043903:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.043909:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.043923:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.043933:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.043941:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.043966:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.043980:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.043986:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.047315:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.047323:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.047337:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.047364:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.047372:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b1009a6/0x902a3611c9ae96bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.049911:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.049919:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.049923:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.052691:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.052705:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.052723:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.052728:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.052734:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.052749:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.052770:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.052780:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.052799:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305442.053607:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.053614:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053626:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.053629:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.053634:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053646:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053655:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053662:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053691:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788305442.053704:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305442.053710:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053717:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.053721:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053731:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053748:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053755:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000451795c0/0x902a3611c9ae96c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053771:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.053775:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053781:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030a00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.053785:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053804:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053816:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053823:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4266b1a/0x902a3611c9ae96cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.053838:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.053840:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.053841:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.054007:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.054859:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.054868:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.054880:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.054884:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.054889:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.054937:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.054948:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.054968:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.054983:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.055373:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.055380:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.055389:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031e00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.055393:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.055403:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.055416:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.055423:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f3567c3/0x902a3611c9ae96d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.055438:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.055440:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.055442:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788305442.056787:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788305442.056886:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.056894:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.056908:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.056913:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.056918:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.056930:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.056939:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.056948:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.056965:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305442.057043:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788305442.057689:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.057696:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057705:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.057708:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.057712:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057733:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057742:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057749:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057766:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305442.057776:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305442.057782:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057790:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305442.057794:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057802:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057819:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057826:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0e8db01/0x902a3611c9ae96e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.057855:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.057857:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.057860:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.058205:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.058214:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031a00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305442.058218:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.058226:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.058241:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.058249:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed43fd7b/0x902a3611c9ae96d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.058269:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.058271:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.058274:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.058493:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.058584:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.058594:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.058598:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.058603:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.058614:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.058623:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.058631:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.058704:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305442.059266:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.059273:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.059295:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.059299:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.059303:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.059314:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.059324:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.059332:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.059975:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305442.059986:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060006:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.060010:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060019:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060037:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060044:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069789c58/0x902a3611c9ae96e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060078:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305442.060082:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060089:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.060092:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060100:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060125:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.060133:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.060135:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.060138:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.060286:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788305442.060292:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d034909/0x902a3611c9ae96ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305442.060836:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.060844:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.060855:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.060859:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.060864:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.060889:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.060899:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.060907:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.061082:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305442.061088:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.061095:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305442.061099:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.061106:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.061118:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305442.061125:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.061127:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.061128:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305442.061828:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788305442.061836:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d99d5c8c/0x902a3611c9ae96f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.063170:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305442.064455:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305442.064466:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.064484:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1788305442.064490:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305442.065101:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.065122:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.065157:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.065166:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305442.065187:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788305442.065430:0:15112:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:3.0:1788305442.065787:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305442.065795:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.065806:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305442.065810:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.065833:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.065850:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.065858:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe94543/0x902a3611c9ae96fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305442.065880:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.065882:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305442.065884:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305442.066131:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14452:x1875173761450368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 86561us (89512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305442.066142:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305442.066487:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875173761450368:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788305442.066503:0:14452:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788305442.068225:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875173761450496:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788305442.068291:0:14452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305442.068340:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb90f38e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305442.068484:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450496 00000100:00100000:2.0:1788305442.068492:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450496 00000100:00100000:2.0:1788305442.068542:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305442.068567:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14452:x1875173761450496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788305442.068612:0:15115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000001:00100000:0.0:1788305442.101422:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788305442.108432:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14452:x1875173761450496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 39858us (40131us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788305442.108447:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305442.108541:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875173761450496:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788305442.108559:0:14452:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788305442.929399:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305443.955633:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305444.977275:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788305445.473436:0:15829:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305445.473440:0:15829:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788305445.473560:0:15829:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96fbc1ad0000 00000020:01000004:3.0:1788305445.473575:0:15829:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788305445.473589:0:15829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788305445.473603:0:15829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96fb850299b8) 00000020:00000080:3.0:1788305445.473622:0:15829:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788305445.494229:0:15829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788305445.494648:0:15829:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788305445.496758:0:15829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788305445.500515:0:15829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788305445.500798:0:15829:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788305445.502693:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 549: rc = 0 00100000:10000000:2.0:1788305445.502812:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:2.0:1788305445.502910:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:2.0:1788305445.504750:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 688: rc = 0 00100000:10000000:2.0:1788305445.505114:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 688: rc = 0 00100000:10000000:2.0:1788305445.505887:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 688: rc = 0 00100000:10000000:2.0:1788305445.507417:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 688: rc = 0 00100000:10000000:2.0:1788305445.507683:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 688: rc = 0 00100000:10000000:2.0:1788305445.507992:0:15829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 688: rc = 0 00000020:00000080:2.0:1788305445.510389:0:15829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788305445.510405:0:15829:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788305445.510418:0:15829:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x902a3611c9ae970a 00000020:01000004:2.0:1788305445.510426:0:15829:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788305445.510448:0:15829:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788305445.510451:0:15829:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788305445.510458:0:15829:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788305445.510481:0:15829:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788305445.510485:0:15829:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788305445.553899:0:15829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788305445.554875:0:15829:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788305445.554883:0:15829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788305445.554885:0:15829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305445.554887:0:15829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305445.554888:0:15829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305445.554889:0:15829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305445.554891:0:15829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305445.554893:0:15829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305445.554895:0:15829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305445.554896:0:15829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305445.554900:0:15829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788305445.554903:0:15829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788305445.554905:0:15829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305445.554906:0:15829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305445.554907:0:15829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305445.554908:0:15829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305445.554910:0:15829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305445.554911:0:15829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305445.554912:0:15829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305445.554913:0:15829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305445.555015:0:15829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788305445.555038:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761450624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788305445.555325:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305445.555438:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb89075f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.556809:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450624 00000100:00100000:2.0:1788305445.556822:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450624 00000100:00100000:0.0:1788305445.557359:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788305445.557371:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15829:x1875173761450624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788305445.557408:0:14422:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788305445.557411:0:14422:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788305445.557414:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788305445.565574:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15829:x1875173761450624:12345-0@lo:253:mount.lustre.0 Request processed in 8195us (10239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.565712:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761450624:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305445.565726:0:15829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788305445.565730:0:15829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305445.565732:0:15829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788305445.565733:0:15829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305445.565734:0:15829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305445.565735:0:15829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305445.565737:0:15829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305445.565738:0:15829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305445.565740:0:15829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305445.565742:0:15829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788305445.565763:0:15829:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96fbc1ad0000 from lustre-OST0001 10000000:01000000:0.0:1788305445.565789:0:15829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788305445.565791:0:15829:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788305445.565799:0:15829:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96fb8502cd28 local copy 00010000:00010000:0.0:1788305445.565810:0:15829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305445.566031:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761450752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305445.566099:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305445.566132:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.566248:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450752 00000100:00100000:2.0:1788305445.566254:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450752 00000100:00100000:2.0:1788305445.566297:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305445.566314:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761450752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305445.566545:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761450752:12345-0@lo:501:mount.lustre.0 Request processed in 232us (445us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305445.566554:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788305445.566732:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788305445.566872:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761450752:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788305445.566888:0:15829:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788305445.567032:0:15829:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788305445.567039:0:15829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.567050:0:15829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbd400/0x902a3611c9ae94b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae94be expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305445.567101:0:15829:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96fbc1ad0000 10000000:01000000:0.0:1788305445.567107:0:15829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788305445.567111:0:15829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788305445.567113:0:15829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305445.567119:0:15829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788305445.567122:0:15829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788305445.567150:0:15829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.567158:0:15829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.567167:0:15829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305445.567192:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761450880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305445.567227:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305445.567256:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.567778:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761450880 00000100:00100000:2.0:1788305445.567785:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761450880 00000100:00100000:2.0:1788305445.567822:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305445.567830:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:15829:x1875173761450880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305445.567841:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305445.567854:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc2044800/0x902a3611c9ae9718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae9711 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.567874:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2044800/0x902a3611c9ae9718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae9711 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.567884:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc2044800/0x902a3611c9ae9718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9711 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.567893:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2044800, rc 0) 00000100:00100000:2.0:1788305445.567942:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761450880:12345-0@lo:101:mount.lustre.0 Request processed in 106us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305445.567949:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788305445.568137:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761450880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305445.568151:0:15829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9718 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.568161:0:15829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9718 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305445.571331:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788305445.572328:0:15829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305445.572532:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788305445.572568:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788305445.572597:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788305445.572634:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788305445.572663:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788305445.572690:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788305445.572741:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788305445.572748:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788305445.572824:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305445.572891:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305445.572944:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.573320:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451008 00000100:00100000:2.0:1788305445.573329:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451008 00000100:00100000:2.0:1788305445.573373:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788305445.573383:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305445.573884:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451008:12345-0@lo:501:mount.lustre.0 Request processed in 501us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305445.573900:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305445.574001:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305445.574042:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305445.574120:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.574150:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305445.574214:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451136 00000100:00100000:3.0:1788305445.574220:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451136 00000100:00100000:3.0:1788305445.574252:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788305445.574259:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305445.574552:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451136:12345-0@lo:503:mount.lustre.0 Request processed in 292us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305445.574558:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305445.574747:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451136:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305445.575249:0:15829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305445.575345:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305445.575385:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.575405:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.575609:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451264 00000100:00100000:2.0:1788305445.575614:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451264 00000100:00100000:2.0:1788305445.575637:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305445.575643:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305445.575822:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451264:12345-0@lo:502:mount.lustre.0 Request processed in 178us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305445.575830:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305445.575977:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305445.576236:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788305445.576280:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788305445.576427:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788305445.576476:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788305445.576509:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788305445.576535:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788305445.576573:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788305445.577130:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788305445.577198:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788305445.577237:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305445.577299:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.578182:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.578532:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451392 00000100:00100000:0.0:1788305445.578540:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451392 00000100:00100000:0.0:1788305445.578595:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788305445.578753:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbba472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305445.579230:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbba472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451392:12345-0@lo:502:mount.lustre.0 Request processed in 625us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.579239:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305445.584770:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305445.584928:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788305445.585077:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788305445.595821:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788305445.595834:0:15830:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788305445.595841:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.595844:0:15830:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788305445.595852:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305445.595867:0:15830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96fba05219b8) 00000020:00000080:3.0:1788305445.595908:0:15830:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788305445.595915:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788305445.596443:0:15830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbc1ad0000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788305445.596454:0:15830:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788305445.596463:0:15830:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x902a3611c9ae9726 00010000:00010000:3.0:1788305445.607399:0:15830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788305445.607825:0:15830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788305445.614724:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788305445.619877:0:15830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788305445.619891:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305445.619898:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305445.619900:0:15830:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788305445.619904:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305445.619908:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305445.619909:0:15830:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788305445.619912:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788305445.619914:0:15830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788305445.619916:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305445.619917:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305445.619919:0:15830:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788305445.619921:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305445.619923:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305445.619925:0:15830:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788305445.619928:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788305445.622118:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305445.622132:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305445.622135:0:15830:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788305445.622140:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788305445.623201:0:15829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788305445.623245:0:15829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788305445.623270:0:15829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9718 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.623283:0:15829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb870bf400/0x902a3611c9ae9711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9718 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305445.623292:0:15829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbc1ad0000 from 1 10000000:01000000:1.0:1788305445.623295:0:15829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305445.623332:0:15829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.623340:0:15829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.623360:0:15829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305445.623386:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305445.623457:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.623501:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.625510:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451520 00000100:00100000:0.0:1788305445.625524:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451520 00000100:00100000:0.0:1788305445.625580:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305445.625589:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbba473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:15829:x1875173761451520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305445.625614:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305445.625631:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae972d expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.625670:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae972d expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.625681:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae972d expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.625689:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bee00, rc 0) 00000100:00100000:0.0:1788305445.625754:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbba473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451520:12345-0@lo:101:mount.lustre.0 Request processed in 166us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.625761:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305445.626175:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305445.626195:0:15829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.626204:0:15829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305445.629228:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788305445.632156:0:15829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305445.632880:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788305445.634462:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788305445.635690:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788305445.635716:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788305445.635819:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305445.635890:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.636165:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.637752:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451648 00000100:00100000:2.0:1788305445.637764:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451648 00000100:00100000:2.0:1788305445.637813:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788305445.637822:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbba471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305445.638148:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbba471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451648:12345-0@lo:501:mount.lustre.0 Request processed in 325us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305445.638156:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305445.638358:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305445.638407:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305445.638453:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.638493:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305445.640132:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451776 00000100:00100000:2.0:1788305445.640145:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451776 00000100:00100000:2.0:1788305445.640200:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305445.640210:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbba473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305445.640587:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbba473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451776:12345-0@lo:503:mount.lustre.0 Request processed in 377us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305445.640594:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305445.642250:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305445.643038:0:15829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305445.643228:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305445.644203:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.644254:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.644355:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761451904 00000100:00100000:0.0:1788305445.644364:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761451904 00000100:00100000:0.0:1788305445.644414:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788305445.644424:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305445.644695:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761451904:12345-0@lo:502:mount.lustre.0 Request processed in 272us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.644704:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305445.644971:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761451904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305445.648991:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788305445.649117:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788305445.649173:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788305445.649213:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788305445.649249:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788305445.649299:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788305445.649342:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788305445.649372:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788305445.649419:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305445.649498:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.649549:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.655436:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452032 00000100:00100000:0.0:1788305445.655449:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452032 00000100:00100000:0.0:1788305445.655519:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788305445.655529:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761452032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305445.655806:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761452032:12345-0@lo:502:mount.lustre.0 Request processed in 277us (6307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.655815:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788305445.656446:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305445.656634:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788305445.656651:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788305445.658620:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305445.658632:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.658634:0:15834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788305445.658641:0:15834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbc1ad0000 00000020:00000080:3.0:1788305445.658644:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305445.658651:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305445.658653:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.658664:0:15834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788305445.658666:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305445.658669:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.658670:0:15834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305445.658681:0:15834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96fbc1ad0000 00000020:00000080:3.0:1788305445.658683:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305445.658737:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305445.658740:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.658741:0:15834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788305445.658743:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305445.658745:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.658746:0:15834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305445.658748:0:15834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96fbc1ad0000 00000020:00000080:3.0:1788305445.658751:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305445.658782:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305445.658785:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305445.658786:0:15834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788305445.658789:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788305445.658971:0:15829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788305445.658996:0:15829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305445.659017:0:15829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.659040:0:15829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305445.659118:0:15829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788305445.659121:0:15829:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96fbc1ad0000 10000000:01000000:2.0:1788305445.659124:0:15829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96fbc1ad0000 10000000:01000000:2.0:1788305445.659128:0:15829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305445.659134:0:15829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96fbc1ad0000 from 1 10000000:01000000:2.0:1788305445.659137:0:15829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305445.659173:0:15829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.659181:0:15829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.659192:0:15829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305445.659218:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305445.659286:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305445.659337:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.659366:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452160 00000100:00100000:0.0:1788305445.659374:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452160 00000100:00100000:0.0:1788305445.659432:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788305445.659442:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761452160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305445.659454:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305445.659466:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870be600/0x902a3611c9ae9742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae973b expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.659489:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870be600/0x902a3611c9ae9742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae973b expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.659498:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870be600/0x902a3611c9ae9742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae973b expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.659507:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be600, rc 0) 00000100:00100000:0.0:1788305445.659546:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452160:12345-0@lo:101:mount.lustre.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.659552:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788305445.659639:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305445.659652:0:15829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9742 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305445.659660:0:15829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae9742 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305445.660842:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788305445.667136:0:15829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305445.668551:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788305445.668612:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788305445.668650:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788305445.668699:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788305445.668737:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788305445.668781:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788305445.668813:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788305445.668845:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788305445.668890:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788305445.668926:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788305445.668961:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788305445.669008:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788305445.669044:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788305445.669107:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788305445.669160:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788305445.669194:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788305445.669222:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788305445.677499:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788305445.677563:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788305445.677598:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788305445.677648:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788305445.677687:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788305445.677722:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788305445.677781:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788305445.677821:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788305445.677854:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788305445.677901:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788305445.677943:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788305445.677979:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788305445.678092:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788305445.678132:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788305445.678165:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788305445.678212:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788305445.678359:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788305445.678398:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788305445.678456:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788305445.678495:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788305445.678594:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788305445.678603:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788305445.679372:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305445.679447:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305445.679498:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.680188:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452288 00000100:00100000:0.0:1788305445.680196:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452288 00000100:00100000:0.0:1788305445.680242:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788305445.680251:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305445.680527:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452288:12345-0@lo:501:mount.lustre.0 Request processed in 276us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.680535:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305445.680813:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305445.680856:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305445.680898:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305445.680920:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.683486:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452416 00000100:00100000:0.0:1788305445.683500:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452416 00000100:00100000:0.0:1788305445.683854:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788305445.683865:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305445.684885:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452416:12345-0@lo:503:mount.lustre.0 Request processed in 1017us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.684900:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788305445.687131:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305445.687782:0:15829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305445.687870:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305445.687957:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.687993:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.689077:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452544 00000100:00100000:0.0:1788305445.689097:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452544 00000100:00100000:0.0:1788305445.689148:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788305445.689157:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305445.689509:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452544:12345-0@lo:502:mount.lustre.0 Request processed in 351us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.689517:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305445.691791:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305445.692121:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788305445.692196:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788305445.692230:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788305445.692273:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788305445.692322:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788305445.692375:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788305445.692415:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788305445.692448:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788305445.692495:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788305445.692534:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788305445.692567:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788305445.696728:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788305445.698407:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788305445.698491:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788305445.698566:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788305445.698603:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788305445.698632:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788305445.703523:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788305445.703570:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788305445.703599:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788305445.703638:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788305445.703668:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788305445.703697:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788305445.703751:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788305445.703785:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788305445.703812:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788305445.703855:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788305445.703887:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788305445.703915:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788305445.703970:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788305445.704014:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788305445.704049:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788305445.704137:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788305445.704186:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788305445.704223:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788305445.704271:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788305445.704308:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788305445.704357:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788305445.704410:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788305445.704445:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788305445.704498:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305445.704575:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.704627:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.705208:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452672 00000100:00100000:0.0:1788305445.705217:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452672 00000100:00100000:0.0:1788305445.705271:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788305445.705280:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305445.705526:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761452672:12345-0@lo:502:mount.lustre.0 Request processed in 246us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.705533:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788305445.705633:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761452672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305445.705719:0:15829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788305445.705733:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788305445.709566:0:15838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788305445.709582:0:15838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96fba0523370) 00000020:00000080:3.0:1788305445.709602:0:15838:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788305445.709685:0:15838:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96fbc1ad0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788305445.709688:0:15838:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96fbc1ad0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788305445.709691:0:15838:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96fbc1ad0000 3 00010000:00080000:3.0:1788305445.709717:0:15838:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96fa82837000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1788305445.718872:0:15838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788305445.720251:0:15838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788305445.720288:0:15838:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305445.720299:0:15838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x902a3611c9ae9750 00000100:00080000:3.0:1788305445.720310:0:15838:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305445.720315:0:15838:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96fa82837000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305445.720348:0:15838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fb90f5e300 x1875173761452800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305445.720386:0:15838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788305445.720481:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875173761452800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305445.720547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788305445.720630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305445.720635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788305445.720637:0:8:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305445.720641:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1788305445.720645:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788305445.720656:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96fba0333000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1788305445.720671:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fbaf279c00 x1875173761453056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305445.720818:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452800 00000100:00100000:0.0:1788305445.720825:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452800 00000100:00100000:0.0:1788305445.720858:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305445.720865:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875173761452800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788305445.720889:0:14429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1788305445.720919:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x902a3611c9ae9757 00000004:00100000:0.0:1788305445.720935:0:14429:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305445.720966:0:14429:0:(import.c:65:import_set_state_nolock()) ffff96fa82776800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305445.721011:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875173761452800:12345-0@lo:38:llog_process_th.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.721019:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305445.721042:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761452928:0@lo:400:kworker.0 00000100:00100000:3.0:1788305445.721257:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761453184:0@lo:400:kworker.0 00000100:00100000:3.0:1788305445.721287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788305445.721440:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1788305445.722464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305445.722518:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761453056:0@lo:8:kworker.0 00000100:00100000:0.0:1788305445.722546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788305445.722580:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fb90f5e300 x1875173761452800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305445.722591:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305445.722600:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788305445.722607:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788305445.722612:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788305445.722614:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fa82837000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788305445.722634:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875173761452800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305445.722663:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761453312:0@lo:400:kworker.0 00000100:00100000:0.0:1788305445.722692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305445.722728:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453184 00000100:00100000:0.0:1788305445.722734:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453184 00000100:00100000:0.0:1788305445.722764:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453312 00000100:00100000:0.0:1788305445.722767:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453312 00000100:00100000:0.0:1788305445.722793:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305445.722800:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761453184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305445.722848:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761453184:12345-0@lo:400:kworker.0 Request processed in 48us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.722854:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305445.722869:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305445.722875:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761453312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305445.722906:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761453312:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.722911:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305445.723320:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761452928 00000100:00100000:0.0:1788305445.723325:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761452928 00000100:00100000:0.0:1788305445.723354:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453056 00000100:00100000:0.0:1788305445.723356:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453056 00000100:00100000:0.0:1788305445.723367:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305445.723372:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761452928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305445.723408:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875173761452928:12345-0@lo:400:kworker.0 Request processed in 36us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.723413:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305445.723422:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305445.723434:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1875173761453056:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788305445.723473:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1875173761453056:12345-0@lo:8:kworker.0 Request processed in 38us (926us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788305445.723479:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788305445.723496:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305445.723499:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305445.723519:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf27aa00 x1875173761453184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305445.723530:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761453184:0@lo:400:kworker.0 00010000:00080000:0.0:1788305445.723552:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96fbaf27b100 x1875173761453312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305445.723560:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761453312:0@lo:400:kworker.0 00000100:00100000:0.0:1788305445.723576:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761452928:0@lo:400:kworker.0 00000100:00100000:0.0:1788305445.723592:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305445.723596:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305445.723599:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788305445.723602:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761453056:0@lo:8:kworker.0 00000020:01000000:1.0:1788305445.725121:0:15829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788305445.725165:0:15829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305445.730847:0:15829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9742 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.730865:0:15829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc2045800/0x902a3611c9ae973b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae9742 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305445.730949:0:15829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305445.730952:0:15829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788305445.730953:0:15829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305445.730954:0:15829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305445.730955:0:15829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305445.730958:0:15829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305445.730959:0:15829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305445.730961:0:15829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305445.730963:0:15829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305445.730967:0:15829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788305445.730970:0:15829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305445.730971:0:15829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788305445.730972:0:15829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305445.730974:0:15829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305445.730975:0:15829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305445.730980:0:15829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305445.730981:0:15829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305445.730983:0:15829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305445.730983:0:15829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305445.731012:0:15829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788305445.731032:0:15829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761453440:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305445.731141:0:15829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.731191:0:15829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb86eb1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305445.731301:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453440 00000100:00100000:1.0:1788305445.731309:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453440 00000100:00100000:1.0:1788305445.731367:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788305445.731378:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:15829:x1875173761453440:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788305445.731405:0:14422:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788305445.731418:0:14422:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788305445.811139:0:14422:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788305445.811162:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788305445.811212:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788305445.811219:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788305445.811255:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305445.811275:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305445.811284:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305445.811334:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305445.811350:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 19 pid: 14422 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305445.811366:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875173761453568:0@lo:104: 00000100:00100000:3.0:1788305445.811433:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305445.811496:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb830696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305445.811809:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453568 00000100:00100000:0.0:1788305445.811817:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453568 00000100:00100000:0.0:1788305445.811868:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305445.811879:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14445:x1875173761453568:12345-0@lo:104: 00010000:00010000:0.0:1788305445.811901:0:14412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305445.811987:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305445.811994:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:14445:x1875173761453568:12345-0@lo:104: Request processed in 117us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305445.812001:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305445.812107:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875173761453568:0@lo:104: 00010000:00010000:3.0:1788305445.812126:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.812395:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305445.812402:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.812409:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbde00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305445.812412:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.812420:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305445.812427:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305445.812433:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305445.812469:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.812484:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305445.812509:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.812517:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbde00/0x902a3611c9ae9631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9638 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.812532:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305445.812534:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305445.812535:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305445.812772:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761453696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305445.812812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305445.813520:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453696 00000100:00100000:1.0:1788305445.813528:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453696 00010000:00010000:1.0:1788305445.813554:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 20 pid: 14422 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305445.813579:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305445.813586:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+20:3304:x1875173761453696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305445.813598:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305445.813603:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 20 pid: 14422 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813613:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 20 pid: 14422 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813627:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb870be200/0x902a3611c9ae9638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae9631 expref: 20 pid: 14422 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813643:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813662:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305445.813677:0:14414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002458221s 00010000:00010000:1.0:1788305445.813681:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813688:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813695:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813702:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813708:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbda00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305445.813712:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813718:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813730:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305445.813737:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305445.813779:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761453696:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305445.813786:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788305445.814016:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305445.814042:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305445.814050:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbb9dbda00/0x902a3611c9ae975e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305445.814428:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761453696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305445.845175:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:15829:x1875173761453440:12345-0@lo:253:mount.lustre.0 Request processed in 113787us (114021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305445.845189:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305445.845531:0:15829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf58ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:15829:1875173761453440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788305445.845546:0:15829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788305445.845550:0:15829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305445.845551:0:15829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305445.845552:0:15829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305445.845553:0:15829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305445.845554:0:15829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305445.845555:0:15829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305445.845568:0:15829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305445.845569:0:15829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305445.845571:0:15829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788305445.845586:0:15829:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788305445.857818:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305445.857987:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788305445.862638:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788305445.862962:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788305445.864114:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788305445.864495:0:15829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788305445.865688:0:15829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788305445.917606:0:15829:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788305445.917615:0:15829:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788305445.917651:0:15829:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788305445.917714:0:15829:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788305445.917728:0:15829:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788305445.917757:0:15829:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788305446.004234:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305447.027467:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305447.156804:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305447.156919:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761453824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305447.156988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305447.157190:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453824 00000100:00100000:0.0:1788305447.157198:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453824 00000100:00100000:0.0:1788305447.157310:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305447.157321:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761453824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305447.157354:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305447.157404:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875173761453824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305447.157411:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305447.157456:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761453824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788305447.158588:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788305447.194888:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:2.0:1788305447.670995:0:14426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788305447.671004:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96fbb9972000 from 8 10000000:01000000:2.0:1788305447.671009:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305447.671085:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305447.671097:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305447.671109:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305447.671134:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761453952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305447.671206:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305447.671251:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb895e4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305447.671276:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761453952 00000100:00100000:2.0:1788305447.671283:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761453952 00000100:00100000:2.0:1788305447.671348:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788305447.671357:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761453952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305447.671369:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305447.671380:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbc2045200/0x902a3611c9ae976c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae9765 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305447.671414:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbc2045200/0x902a3611c9ae976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae9765 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305447.671424:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbc2045200/0x902a3611c9ae976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae9765 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305447.671433:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbc2045200, rc 0) 00000100:00100000:2.0:1788305447.671480:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761453952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305447.671486:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305447.672344:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761453952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305447.672362:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae976c expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305447.672373:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae976c expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305447.672434:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761454080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788305447.672725:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305447.679543:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb83069f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305447.681430:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454080 00000100:00100000:1.0:1788305447.681443:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454080 00000100:00100000:1.0:1788305447.681495:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305447.681505:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761454080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788305447.681529:0:14422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305447.681553:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305447.681556:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788305447.681691:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761454080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (8965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305447.681699:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788305447.684183:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761454080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788305447.684427:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305447.684439:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae976c expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305447.684450:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbc2044c00/0x902a3611c9ae9765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae976c expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305448.053282:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305448.500028:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305449.073270:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.098675:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305450.740090:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761454208:0@lo:400:kworker.0 00000100:00100000:1.0:1788305450.740168:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305450.740264:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454208 00000100:00100000:1.0:1788305450.740285:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454208 00000100:00100000:1.0:1788305450.740328:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788305450.740337:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3302:x1875173761454208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305450.740386:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3302:x1875173761454208:12345-0@lo:400:kworker.0 Request processed in 49us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305450.740393:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788305450.740440:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761454208:0@lo:400:kworker.0 00000100:00080000:3.0:1788305450.744906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305450.744913:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305450.744916:0:8:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305450.744929:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96fba0333000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1788305450.744953:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96fb90f5ca80 x1875173761454464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305450.745077:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761454592:0@lo:400:kworker.0 00000100:00100000:3.0:1788305450.745148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305450.745194:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305450.745200:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761454336:0@lo:400:kworker.0 00000100:00100000:3.0:1788305450.745237:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305450.745265:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761454720:0@lo:400:kworker.0 00000100:00100000:3.0:1788305450.745293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305450.745310:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305450.745315:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761454848:0@lo:400:kworker.0 00000100:00100000:3.0:1788305450.745338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305450.748246:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454592 00000100:00100000:2.0:1788305450.748261:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454592 00000100:00100000:2.0:1788305450.748311:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454720 00000100:00100000:2.0:1788305450.748314:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454720 00000100:00100000:2.0:1788305450.748346:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454848 00000100:00100000:2.0:1788305450.748349:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454848 00000100:00100000:2.0:1788305450.748368:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305450.748379:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761454592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305450.748470:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761454592:12345-0@lo:400:kworker.0 Request processed in 93us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305450.748490:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305450.748505:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305450.748511:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761454720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305450.748538:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875173761454720:12345-0@lo:400:kworker.0 Request processed in 28us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305450.748544:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305450.748552:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305450.748557:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761454848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305450.748576:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761454848:12345-0@lo:400:kworker.0 Request processed in 20us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305450.748581:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305450.748597:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454336 00000100:00100000:2.0:1788305450.748601:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454336 00000100:00100000:2.0:1788305450.748623:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305450.748628:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761454336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305450.748654:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761454336:12345-0@lo:400:kworker.0 Request processed in 26us (3417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305450.748659:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305450.748682:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761454464:0@lo:8:kworker.0 00000100:00100000:2.0:1788305450.748712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788305450.748740:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305450.748744:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305450.748768:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788305450.748786:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761454336:0@lo:400:kworker.0 00010000:00080000:2.0:1788305450.748799:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb90f5e680 x1875173761454592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305450.748831:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761454592:0@lo:400:kworker.0 00000100:00100000:3.0:1788305450.749492:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454464 00000100:00100000:3.0:1788305450.749499:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454464 00000100:00100000:3.0:1788305450.749540:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305450.749546:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875173761454464:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788305450.749573:0:15112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1788305450.749600:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x902a3611c9ae9773 00002000:00100000:3.0:1788305450.749615:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96fa82831000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788305450.749619:0:15112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788305450.749621:0:15112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305450.749962:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788305450.749986:0:15112:0:(import.c:65:import_set_state_nolock()) ffff96fa82834800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305450.750118:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875173761454464:12345-0@lo:8:kworker.0 Request processed in 570us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305450.750125:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788305450.750174:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb90f5ea00 x1875173761454848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305450.750199:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761454848:0@lo:400:kworker.0 00010000:00080000:2.0:1788305450.751887:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb90f5ca80 x1875173761454464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788305450.751906:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788305450.751914:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788305450.751920:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788305450.751923:0:3300:0:(import.c:65:import_set_state_nolock()) ffff96fba0333000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788305450.751950:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788305450.751957:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875173761454464:0@lo:8:kworker.0 00000004:00080000:2.0:1788305450.752043:0:14454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788305450.752087:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875173761455104:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788305450.752142:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305450.752171:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb895e4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305450.752186:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761454976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305450.752223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305450.752257:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455104 00000100:00100000:2.0:1788305450.752263:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455104 00000100:00100000:2.0:1788305450.752312:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305450.752322:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1875173761455104:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788305450.754746:0:15114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788305450.754756:0:15114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788305450.754761:0:15114:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:3.0:1788305450.755285:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fb90f5c000 x1875173761454720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305450.755303:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875173761454720:0@lo:400:kworker.0 00000100:00100000:0.0:1788305450.755682:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761454976 00000100:00100000:0.0:1788305450.755690:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761454976 00000100:00100000:0.0:1788305450.755730:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305450.755741:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761454976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305450.755776:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305450.755871:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875173761454976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305450.755879:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788305450.756013:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96fa83231180 x1875173761454976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305450.756045:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761454976:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788305450.756799:0:14453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788305450.757251:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 468467196527ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788305450.757537:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788305450.795698:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.795712:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795728:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.795732:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.795738:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795754:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795765:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795772:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795792:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.795812:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.795818:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795826:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031e00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.795831:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795840:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795858:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795864:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae977a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.795881:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.795883:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.795884:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.796696:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.796704:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796715:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.796719:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.796724:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796747:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796756:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796764:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796780:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.796791:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.796795:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796802:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030a00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.796806:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796814:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796826:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796834:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4266b1a/0x902a3611c9ae9781 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.796856:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.796858:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.796859:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.797302:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.797308:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797317:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.797320:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.797324:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797333:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797341:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797348:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797362:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.797370:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.797374:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797391:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.797394:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797402:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797414:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797419:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1009a6/0x902a3611c9ae9788 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797431:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.797433:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.797435:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.797818:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.797825:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797836:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.797839:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.797843:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797852:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797867:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797874:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797888:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.797896:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.797901:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797907:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.797910:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797917:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797928:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797935:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0e8db01/0x902a3611c9ae978f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.797949:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.797957:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.797959:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.798394:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.798400:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798408:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.798410:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.798414:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798423:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798430:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798437:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798451:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.798459:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.798463:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798469:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.798472:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798491:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798501:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798508:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d034909/0x902a3611c9ae9796 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798523:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.798524:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.798526:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.798938:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.798944:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798952:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.798955:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.798958:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798966:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798972:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.798986:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.801314:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305450.802135:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305450.802146:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.802168:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305450.802173:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.802184:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.802208:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.802549:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae979d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.802575:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305450.802577:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305450.802579:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.803436:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.803445:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803458:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.803463:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.803468:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803480:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803490:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803497:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803516:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.803526:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.803532:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803545:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.803549:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803558:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803570:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803577:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae97a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.803595:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.803597:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.803598:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.804036:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.804043:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804074:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.804078:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.804083:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804092:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804110:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804118:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804136:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.804147:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.804152:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804159:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031a00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.804163:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804171:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804183:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804190:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae97ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804206:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.804214:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.804216:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.804652:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.804659:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804669:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.804672:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.804676:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804685:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804692:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804698:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804711:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.804719:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.804723:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804729:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.804732:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804749:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804759:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804766:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae97b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.804779:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.804781:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.804783:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.814694:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.814708:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814727:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.814732:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.814739:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814753:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814764:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814777:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814794:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.814806:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.814811:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814818:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.814823:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814833:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814849:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814857:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e82967/0x902a3611c9ae97b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.814874:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.814876:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.814877:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.815363:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.815377:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815387:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.815391:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.815396:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815405:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815413:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815421:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815435:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.815445:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.815449:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815456:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031e00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.815459:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815467:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815484:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815491:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f3567c3/0x902a3611c9ae97c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815504:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.815506:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.815508:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.815860:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.815867:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815875:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.815878:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.815882:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815892:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815900:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815908:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815933:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.815942:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.815945:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815951:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.815954:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815961:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815971:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815978:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003450ae10/0x902a3611c9ae97c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.815990:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.815991:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.815993:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.816426:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.816432:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816439:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.816448:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.816453:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816463:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816470:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816477:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816491:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.816500:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.816504:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816510:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fa00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.816514:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816521:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816530:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816547:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a6d398f/0x902a3611c9ae97ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816561:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.816563:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.816565:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.816944:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.816950:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816958:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.816961:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.816966:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816974:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816982:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.816989:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.817966:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.817977:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.817986:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818005:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.818010:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818019:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818034:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818042:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031206f0e/0x902a3611c9ae97d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818076:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.818078:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.818080:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.818840:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.818848:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818860:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.818864:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.818869:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818891:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818900:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818907:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818921:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.818929:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.818933:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818939:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fe00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.818942:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818950:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818961:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818968:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a44c9cbe/0x902a3611c9ae97dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.818985:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.818987:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.818989:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.819394:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.819400:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819408:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.819412:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.819416:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819425:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819433:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819440:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819453:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.819459:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.819463:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819479:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.819483:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819492:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819501:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819508:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a0193c/0x902a3611c9ae97e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819520:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.819521:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.819523:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.819865:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.819871:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819879:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.819882:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.819886:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819895:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819908:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819915:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819926:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.819933:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.819936:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819943:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fc00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.819947:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819954:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819964:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819970:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000780a07a6/0x902a3611c9ae97ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.819982:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.819988:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.819990:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.820373:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.820379:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820388:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.820391:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.820395:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820404:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820413:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820420:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820432:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.820439:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.820442:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820449:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.820452:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820470:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820481:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820489:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c43db8f9/0x902a3611c9ae97f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820500:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.820502:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.820503:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.820864:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.820870:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820879:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.820883:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.820887:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820897:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820905:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820917:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820929:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305450.820936:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305450.820940:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820946:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305450.820950:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820957:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820967:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820975:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e86018a/0x902a3611c9ae97f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.820985:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.820987:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.820988:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.822599:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.822617:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.822631:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.822636:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.822641:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.822654:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.822663:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.822671:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.822692:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305450.822970:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305450.822978:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.822988:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f800 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305450.822992:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.823012:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.823033:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.823041:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000d6ed23/0x902a3611c9ae97ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.823073:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305450.823075:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305450.823077:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.823483:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.823489:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.823497:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.823500:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.823504:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.823513:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.823525:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.823532:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.823591:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305450.824151:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.824158:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.824167:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.824172:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.824175:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.824185:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.824191:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.824198:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824312:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305450.824325:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824333:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305450.824336:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824344:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824357:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824364:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000591f3e11/0x902a3611c9ae9806 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824380:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305450.824383:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824388:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ec00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305450.824391:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824398:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824418:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.824424:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305450.824426:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305450.824428:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.824808:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788305450.824824:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f16259d/0x902a3611c9ae980d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305450.825597:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.825605:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.825616:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.825620:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.825625:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.825635:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.825644:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.825652:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.825670:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305450.826129:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.826135:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826149:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.826152:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.826155:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826164:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826171:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826179:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826187:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788305450.826733:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.826739:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826748:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.826751:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.826756:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826767:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826786:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826794:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.826803:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788305450.827339:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788305450.827347:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827355:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ea00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305450.827360:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827369:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827388:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827395:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d556c057/0x902a3611c9ae9814 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827416:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305450.827420:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827426:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e200 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305450.827435:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827443:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827452:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827458:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047aa39d6/0x902a3611c9ae981b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827471:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305450.827474:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827480:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305450.827483:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827491:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827500:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827508:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d99d5c8c/0x902a3611c9ae9822 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305450.827528:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305450.827530:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305450.827532:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.829197:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788305450.829959:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.830005:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.830025:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.830029:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.830036:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.830050:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.830169:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.830178:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.830864:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305450.831096:0:14417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305450.831104:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.831113:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305450.831118:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.831127:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.831143:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.831150:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069789c58/0x902a3611c9ae9829 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305450.831172:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305450.831174:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305450.831182:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305450.831774:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.831782:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.834311:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.834317:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.834325:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.834341:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.834354:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.834363:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.834432:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305450.835093:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788305450.835101:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.835112:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1788305450.835123:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305450.835127:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.835137:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.835145:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305450.835151:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305450.838836:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788305450.839917:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305450.839930:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.839943:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80031a00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305450.839948:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.839959:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.839988:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.840009:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed43fd7b/0x902a3611c9ae9830 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.840042:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305450.840046:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.840118:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305450.840122:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.840131:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.840142:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305450.840150:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305450.840151:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305450.840154:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305450.840321:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788305450.840329:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fe94543/0x902a3611c9ae9837 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788305450.840720:0:15114:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788305450.840832:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1875173761455104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88509us (88686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305450.840842:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305450.842133:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875173761455104:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788305450.842152:0:14454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788305450.842267:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875173761455232:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788305450.842314:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305450.842358:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb895e4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305450.842376:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455232 00000100:00100000:2.0:1788305450.842382:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455232 00000100:00100000:2.0:1788305450.842422:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305450.842430:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14454:x1875173761455232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788305450.842467:0:15115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1788305450.844921:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305450.853516:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14454:x1875173761455232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11068us (11182us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788305450.853530:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305450.853647:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875173761455232:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788305450.853663:0:14454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788305451.122686:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788305451.368163:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788305451.368178:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:2.0:1788305452.063571:0:16186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788305452.153138:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305452.275990:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305452.276013:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761455360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305452.276104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305452.276177:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455360 00000100:00100000:2.0:1788305452.276555:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455360 00000100:00100000:2.0:1788305452.276616:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305452.276627:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761455360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305452.276668:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305452.276734:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761455360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305452.276752:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788305452.276775:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305452.276813:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761455360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305453.171009:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305454.193202:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305454.652048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.652184:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536128 00000100:00100000:1.0:1788305454.652194:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536128 00000100:00100000:1.0:1788305454.652241:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:1.0:1788305454.652250:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875173741536128:12345-192.168.201.38@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788305454.652277:0:14424:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fb144db7-147f-43fe-ab32-9ad6a5efc614@192.168.201.38@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788305454.652308:0:14424:0:(genops.c:1385:class_connect()) connect: client fb144db7-147f-43fe-ab32-9ad6a5efc614, cookie 0x902a3611c9ae983e 00000100:00080000:1.0:1788305454.652460:0:14424:0:(import.c:65:import_set_state_nolock()) ffff96fbaf138800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305454.652532:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+5:2346:x1875173741536128:12345-192.168.201.38@tcp:250:mount.lustre.0 Request processed in 281us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.652540:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1788305454.663655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.663778:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536256 00000100:00100000:1.0:1788305454.663851:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536256 00000100:00100000:1.0:1788305454.663973:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:1.0:1788305454.663985:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+5:13758:x1875173741536256:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788305454.664001:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305454.664018:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae9845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7e8 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305454.664046:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae9845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7e8 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305454.664093:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80030a00/0x902a3611c9ae9845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7e8 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305454.664103:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80030a00, rc 0) 00000100:00100000:1.0:1788305454.664169:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+6:13758:x1875173741536256:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 186us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.664177:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:3.0:1788305454.666845:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305454.666956:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536384 00000100:00100000:2.0:1788305454.666966:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536384 00000100:00100000:2.0:1788305454.667022:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:2.0:1788305454.667033:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+6:13758:x1875173741536384:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788305454.667348:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+6:13758:x1875173741536384:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 316us (511us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305454.667357:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:3.0:1788305454.671505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.671673:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536512 00000100:00100000:1.0:1788305454.671682:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536512 00000100:00100000:1.0:1788305454.671741:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:1.0:1788305454.671752:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+6:13758:x1875173741536512:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788305454.671769:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305454.671813:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031200/0x902a3611c9ae984c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a7ef expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305454.671841:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031200/0x902a3611c9ae984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7ef expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305454.671853:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031200/0x902a3611c9ae984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a7ef expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305454.671862:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031200, rc 0) 00000100:00100000:1.0:1788305454.671921:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+7:13758:x1875173741536512:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 171us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.671938:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1788305454.683174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305454.683350:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536640 00000100:00100000:0.0:1788305454.683360:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536640 00000100:00100000:0.0:1788305454.683422:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:0.0:1788305454.683433:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+7:13758:x1875173741536640:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788305454.683740:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13758:x1875173741536640:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 308us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305454.683749:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1788305454.686200:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305454.686350:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536768 00000100:00100000:2.0:1788305454.686359:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536768 00000100:00100000:2.0:1788305454.686418:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:2.0:1788305454.686428:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13758:x1875173741536768:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788305454.686648:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13758:x1875173741536768:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 220us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305454.686656:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:3.0:1788305454.694687:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.695174:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741536896 00000100:00100000:1.0:1788305454.695185:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741536896 00000100:00100000:1.0:1788305454.695247:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:1.0:1788305454.695259:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13777:x1875173741536896:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305454.695533:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13777:x1875173741536896:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 275us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.695542:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1788305454.745431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305454.745533:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537024 00000100:00100000:0.0:1788305454.745542:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537024 00000100:00100000:0.0:1788305454.745594:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:0.0:1788305454.745603:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13777:x1875173741537024:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305454.745862:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13777:x1875173741537024:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 259us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305454.745870:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:3.0:1788305454.761977:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305454.762106:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537152 00000100:00100000:2.0:1788305454.762116:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537152 00000100:00100000:2.0:1788305454.762179:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:2.0:1788305454.762190:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+8:13758:x1875173741537152:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788305454.762208:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305454.762228:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7ca00/0x902a3611c9ae9853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a819 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305454.762275:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7ca00/0x902a3611c9ae9853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a819 expref: 9 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305454.762287:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7ca00/0x902a3611c9ae9853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a819 expref: 9 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305454.762297:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ca00, rc 0) 00000100:00100000:2.0:1788305454.762359:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+9:13758:x1875173741537152:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 170us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305454.762366:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:3.0:1788305454.771107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.771215:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537280 00000100:00100000:1.0:1788305454.771226:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537280 00000100:00100000:1.0:1788305454.771285:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:1.0:1788305454.771295:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+9:13758:x1875173741537280:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788305454.771320:0:14422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788305454.771343:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788305454.771347:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788305454.771351:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788305454.771358:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788305454.774594:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+9:13758:x1875173741537280:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 3287us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.774611:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:2.0:1788305454.780333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305454.780420:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537408 00000100:00100000:0.0:1788305454.780431:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537408 00000100:00100000:0.0:1788305454.780486:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:0.0:1788305454.780498:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+9:13758:x1875173741537408:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305454.780514:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305454.780543:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a820 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305454.780572:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305454.780583:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305454.780593:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bea00, rc 0) 00000100:00100000:0.0:1788305454.780660:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13758:x1875173741537408:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 164us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305454.780667:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:3.0:1788305454.784553:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.784710:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537536 00000100:00100000:1.0:1788305454.784720:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537536 00000100:00100000:1.0:1788305454.784775:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:1.0:1788305454.784794:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13758:x1875173741537536:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788305454.785679:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13758:x1875173741537536:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 893us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.785689:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:1.0:1788305454.788493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305454.788609:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537664 00000100:00100000:2.0:1788305454.788620:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537664 00000100:00100000:2.0:1788305454.788715:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:2.0:1788305454.788727:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13758:x1875173741537664:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788305454.788989:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13758:x1875173741537664:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 263us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305454.788996:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:3.0:1788305454.792538:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305454.793339:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537792 00000100:00100000:0.0:1788305454.793351:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537792 00000100:00100000:2.0:1788305454.793457:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:2.0:1788305454.793471:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13779:x1875173741537792:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305454.793723:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13779:x1875173741537792:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 255us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305454.793732:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1788305454.796377:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.808691:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741537920 00000100:00100000:1.0:1788305454.808707:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741537920 00000100:00100000:1.0:1788305454.808770:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:1.0:1788305454.808792:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13779:x1875173741537920:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305454.809085:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13779:x1875173741537920:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 293us (12714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.809103:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:3.0:1788305454.823045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305454.823367:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538048 00000100:00100000:2.0:1788305454.823390:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538048 00000100:00100000:2.0:1788305454.823435:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1788305454.823445:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1875173741538048:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788305454.823477:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ef8d8297-bdd4-4b4d-84ef-5867cfcd497c@192.168.201.38@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1788305454.823530:0:14431:0:(genops.c:1385:class_connect()) connect: client ef8d8297-bdd4-4b4d-84ef-5867cfcd497c, cookie 0x902a3611c9ae9861 00000004:00100000:2.0:1788305454.823560:0:14431:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788305454.823565:0:14431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788305454.888543:0:14431:0:(import.c:65:import_set_state_nolock()) ffff96fa8344e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305454.888642:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2346:x1875173741538048:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 65195us (65607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305454.888654:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788305454.892410:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305454.892457:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305454.892616:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538176 00000100:00100000:0.0:1788305454.892626:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538176 00000100:00100000:0.0:1788305454.892705:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538304 00000100:00100000:0.0:1788305454.892708:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538304 00000100:00100000:0.0:1788305454.892724:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788305454.892735:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:0:x1875173741538176:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788305454.892787:0:14429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788305454.892876:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:0:x1875173741538176:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 142us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305454.892884:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788305454.892900:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1788305454.892907:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13758:x1875173741538304:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788305454.892918:0:14429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788305454.892969:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13758:x1875173741538304:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 62us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305454.892975:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00080000:1.0:1788305454.893267:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305454.896376:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305454.900608:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538432 00000100:00100000:2.0:1788305454.900624:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538432 00000100:00100000:2.0:1788305454.900706:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1788305454.900717:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13758:x1875173741538432:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788305454.900822:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13758:x1875173741538432:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 106us (4454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305454.900830:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788305454.904866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305454.904981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305454.916802:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538560 00000100:00100000:1.0:1788305454.916817:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538560 00000100:00100000:1.0:1788305454.916870:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538688 00000100:00100000:1.0:1788305454.916873:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538688 00000100:00100000:1.0:1788305454.916893:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305454.916901:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875173741538560:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788305454.916944:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ef8d8297-bdd4-4b4d-84ef-5867cfcd497c@192.168.201.38@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788305454.916992:0:15114:0:(genops.c:1385:class_connect()) connect: client ef8d8297-bdd4-4b4d-84ef-5867cfcd497c, cookie 0x902a3611c9ae9868 00002000:00100000:1.0:1788305454.917005:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ef8d8297-bdd4-4b4d-84ef-5867cfcd497c/ffff96fbaf13f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305454.917031:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788305454.917261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305454.917301:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538816 00000100:00100000:3.0:1788305454.917306:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538816 00000100:00100000:3.0:1788305454.917358:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1788305454.917364:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13758:x1875173741538816:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788305454.917910:0:14432:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 483us 00002000:00080000:1.0:1788305454.918767:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788305454.918806:0:15114:0:(import.c:65:import_set_state_nolock()) ffff96fbaf13e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305454.918879:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2346:x1875173741538560:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 1977us (14022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.918890:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305454.918915:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1788305454.918921:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875173741538688:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788305454.918956:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ef8d8297-bdd4-4b4d-84ef-5867cfcd497c@192.168.201.38@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788305454.918982:0:15114:0:(genops.c:1385:class_connect()) connect: client ef8d8297-bdd4-4b4d-84ef-5867cfcd497c, cookie 0x902a3611c9ae986f 00002000:00100000:1.0:1788305454.918992:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef8d8297-bdd4-4b4d-84ef-5867cfcd497c/ffff96fbaf13d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305454.919010:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788305454.920794:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788305454.920829:0:15114:0:(import.c:65:import_set_state_nolock()) ffff96fbaf13b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305454.920899:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2346:x1875173741538688:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 1975us (15916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.920908:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000004:00200000:1.0:1788305454.949912:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788305454.950136:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13758:x1875173741538816:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 32765us (32870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305454.950151:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00010000:00010000:0.0:1788305455.224271:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305455.241325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305455.241424:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741538944 00000100:00100000:2.0:1788305455.241434:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741538944 00000100:00100000:2.0:1788305455.241502:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1788305455.241512:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:13800:x1875173741538944:12345-192.168.201.38@tcp:101:mkdir.0 00010000:00010000:2.0:1788305455.241530:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305455.241555:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a84a expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305455.241635:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae987d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305455.241649:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae987d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305455.241663:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae987d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305455.241876:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788305455.241880:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305455.241999:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae987d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305455.242028:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a84a expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305455.242045:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae987d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a84a expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305455.242112:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:2.0:1788305455.242116:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305455.242119:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d000, rc 0) 00000100:00100000:2.0:1788305455.242203:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:13800:x1875173741538944:12345-192.168.201.38@tcp:101:mkdir.0 Request processed in 691us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305455.242211:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305455.857372:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305455.857409:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761455488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305455.857487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305455.857640:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455488 00000100:00100000:2.0:1788305455.857648:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455488 00000100:00100000:2.0:1788305455.857719:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305455.857728:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761455488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305455.857750:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305455.857799:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761455488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305455.857806:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788305455.857900:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305455.857939:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788305455.857974:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761455488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305455.858225:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761455744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305455.858260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305455.858292:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305455.858298:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761455872:0@lo:400:kworker.0 00000100:00100000:0.0:1788305455.858324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305455.858389:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455744 00000100:00100000:2.0:1788305455.858394:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455744 00000100:00100000:2.0:1788305455.858435:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305455.858442:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761455744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305455.858486:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761455744:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305455.858493:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305455.858515:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455872 00000100:00100000:2.0:1788305455.858518:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455872 00000100:00100000:2.0:1788305455.858542:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305455.858548:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761455872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305455.858579:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761455872:12345-0@lo:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305455.858584:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305455.858615:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761455872:0@lo:400:kworker.0 00000100:00100000:2.0:1788305455.858623:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761455744:0@lo:400:kworker.0 00000100:00080000:0.0:1788305455.858684:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305455.858736:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761455616:0@lo:400:kworker.0 00000100:00100000:1.0:1788305455.858765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305455.858797:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761456128:0@lo:400:kworker.0 00000100:00100000:1.0:1788305455.858825:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305455.858850:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305455.858856:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761456000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305455.858880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305455.858903:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456128 00000100:00100000:1.0:1788305455.858917:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456128 00000100:00100000:1.0:1788305455.858940:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456000 00000100:00100000:1.0:1788305455.858943:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456000 00000100:00080000:0.0:1788305455.859044:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305455.859101:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305455.859145:0:14431:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305455.859153:0:14431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788305455.859168:0:14430:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305455.859175:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305455.859391:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761455616 00000100:00100000:3.0:1788305455.859394:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761455616 00000100:00100000:3.0:1788305455.859414:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788305455.859419:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3302:x1875173761455616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305455.859454:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3302:x1875173761455616:12345-0@lo:400:kworker.0 Request processed in 34us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305455.859461:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788305455.859620:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761455616:0@lo:400:kworker.0 00000100:00100000:1.0:1788305455.863423:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761456128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305455.863577:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761456128:12345-0@lo:400:kworker.0 Request processed in 4468us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305455.863586:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305455.863679:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761456000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305455.863721:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875173761456000:12345-0@lo:400:kworker.0 Request processed in 4540us (4841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305455.863726:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305455.863974:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761456128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305455.864001:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875173761456000:0@lo:400:kworker.0 00010000:00010000:3.0:1788305456.241223:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788305456.469255:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8d8297-bdd4-4b4d-84ef-5867cfcd497c 00010000:00010000:0.0:1788305457.266551:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305457.393527:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305457.393551:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761456256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305457.393622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305457.394362:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456256 00000100:00100000:2.0:1788305457.394371:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456256 00000100:00100000:2.0:1788305457.394455:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305457.394467:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761456256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305457.394502:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305457.394571:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761456256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305457.394578:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788305457.394650:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305457.394688:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83232d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761456256:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788305457.479271:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef8d8297-bdd4-4b4d-84ef-5867cfcd497c 00000100:00100000:0.0:1788305457.751445:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305457.751551:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539072 00000100:00100000:3.0:1788305457.751561:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539072 00000100:00100000:3.0:1788305457.751650:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788305457.751661:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:13853:x1875173741539072:12345-192.168.201.38@tcp:41:lfs.0 00000004:00000024:3.0:1788305457.751707:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788305457.751805:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:13853:x1875173741539072:12345-192.168.201.38@tcp:41:lfs.0 Request processed in 146us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305457.751813:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00080000:1.0:1788305457.752216:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305457.755149:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305457.755721:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539200 00000100:00100000:2.0:1788305457.755730:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539200 00000100:00100000:2.0:1788305457.755791:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1788305457.755799:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:13853:x1875173741539200:12345-192.168.201.38@tcp:13:lfs.0 00002000:00000024:2.0:1788305457.755820:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305457.755960:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:13853:x1875173741539200:12345-192.168.201.38@tcp:13:lfs.0 Request processed in 159us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305457.755968:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00080000:1.0:1788305457.756043:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305457.768711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305457.772021:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539328 00000100:00100000:0.0:1788305457.772038:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539328 00000100:00100000:0.0:1788305457.772174:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1788305457.772186:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:13853:x1875173741539328:12345-192.168.201.38@tcp:13:lfs.0 00002000:00000024:0.0:1788305457.772225:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305457.772340:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:13853:x1875173741539328:12345-192.168.201.38@tcp:13:lfs.0 Request processed in 146us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305457.772348:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00080000:1.0:1788305457.772433:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305458.062647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305458.066744:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539456 00000100:00100000:2.0:1788305458.066765:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539456 00000100:00100000:2.0:1788305458.066927:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:2.0:1788305458.066943:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+10:13883:x1875173741539456:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788305458.066973:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305458.067017:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae9884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a851 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.067095:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae9884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a851 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.067109:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7c000/0x902a3611c9ae9884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a851 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.067121:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c000, rc 0) 00000100:00100000:2.0:1788305458.067214:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13883:x1875173741539456:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 275us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.067221:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:2.0:1788305458.081991:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305458.082383:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539584 00000100:00100000:3.0:1788305458.082397:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539584 00000100:00100000:3.0:1788305458.082474:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:3.0:1788305458.082487:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13883:x1875173741539584:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788305458.083625:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13883:x1875173741539584:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 1136us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305458.083637:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:0.0:1788305458.091652:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305458.092307:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539712 00000100:00100000:2.0:1788305458.092323:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539712 00000100:00100000:2.0:1788305458.092404:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:2.0:1788305458.092417:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa81850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13883:x1875173741539712:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788305458.094278:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa81850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13883:x1875173741539712:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 1853us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.094292:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:0.0:1788305458.119023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305458.119412:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539840 00000100:00100000:3.0:1788305458.119428:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539840 00000100:00100000:3.0:1788305458.119555:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:3.0:1788305458.119568:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13891:x1875173741539840:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305458.122263:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13891:x1875173741539840:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 2678us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.122280:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:1.0:1788305458.206643:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305458.207024:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741539968 00000100:00100000:2.0:1788305458.207038:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741539968 00000100:00100000:2.0:1788305458.207154:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:2.0:1788305458.207166:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13891:x1875173741539968:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305458.208028:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13891:x1875173741539968:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 859us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.208185:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:2.0:1788305458.223547:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305458.225326:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540096 00000100:00100000:0.0:1788305458.225345:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540096 00000100:00100000:0.0:1788305458.225432:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1788305458.225445:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb87d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13883:x1875173741540096:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305458.225468:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305458.225494:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb870bf200/0x902a3611c9ae988b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a87b expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305458.225544:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb870bf200/0x902a3611c9ae988b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a87b expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305458.225558:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb870bf200/0x902a3611c9ae988b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a87b expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305458.225571:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf200, rc 0) 00000100:00100000:0.0:1788305458.225659:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb87d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13883:x1875173741540096:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 216us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.225667:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1788305458.235905:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305458.241236:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540224 00000100:00100000:2.0:1788305458.241259:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540224 00000100:00100000:0.0:1788305458.242822:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:0.0:1788305458.242838:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13883:x1875173741540224:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788305458.242883:0:14424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788305458.242921:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788305458.242932:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788305458.242935:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788305458.242938:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788305458.261620:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13883:x1875173741540224:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 18762us (25706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.261643:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:3.0:1788305458.284211:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305458.284386:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540352 00000100:00100000:1.0:1788305458.284402:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540352 00000100:00100000:1.0:1788305458.284469:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:1.0:1788305458.284484:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13883:x1875173741540352:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788305458.284511:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305458.284535:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a882 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305458.284575:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305458.284588:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305458.284598:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031e00, rc 0) 00000100:00100000:1.0:1788305458.284677:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13883:x1875173741540352:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 196us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305458.284684:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00010000:00010000:0.0:1788305458.289563:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305458.289709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305458.289905:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540480 00000100:00100000:0.0:1788305458.289918:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540480 00000100:00100000:0.0:1788305458.289984:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:0.0:1788305458.289995:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13883:x1875173741540480:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788305458.290412:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13883:x1875173741540480:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 417us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.290421:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:2.0:1788305458.294190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305458.294449:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540608 00000100:00100000:0.0:1788305458.294462:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540608 00000100:00100000:0.0:1788305458.294528:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:0.0:1788305458.294541:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13883:x1875173741540608:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788305458.296172:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13883:x1875173741540608:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 1624us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.296186:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:2.0:1788305458.306639:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305458.306997:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540736 00000100:00100000:1.0:1788305458.307011:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540736 00000100:00100000:1.0:1788305458.307118:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:1.0:1788305458.307130:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13897:x1875173741540736:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305458.307616:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13897:x1875173741540736:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 486us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305458.307625:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:1.0:1788305458.321982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305458.322269:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540864 00000100:00100000:0.0:1788305458.322283:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540864 00000100:00100000:0.0:1788305458.322349:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:0.0:1788305458.322361:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13897:x1875173741540864:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305458.322706:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13897:x1875173741540864:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 346us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.322731:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:2.0:1788305458.353512:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305458.354183:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741540992 00000100:00100000:1.0:1788305458.354196:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741540992 00000100:00100000:1.0:1788305458.354257:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1788305458.354270:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875173741540992:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788305458.354402:0:14429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb@192.168.201.38@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1788305458.354452:0:14429:0:(genops.c:1385:class_connect()) connect: client e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb, cookie 0x902a3611c9ae9899 00000004:00100000:1.0:1788305458.354493:0:14429:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788305458.354658:0:14429:0:(import.c:65:import_set_state_nolock()) ffff96fbaf13a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305458.355376:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2346:x1875173741540992:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 1105us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305458.355386:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1788305458.373524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305458.373722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305458.389875:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541120 00000100:00100000:3.0:1788305458.389896:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541120 00000100:00100000:3.0:1788305458.390014:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541248 00000100:00100000:3.0:1788305458.390018:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541248 00000100:00100000:3.0:1788305458.390067:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00080000:1.0:1788305458.390197:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305458.390222:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788305458.390232:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+7:13883:x1875173741541248:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305458.390291:0:14429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788305458.390408:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+7:13883:x1875173741541248:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 177us (16685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305458.390416:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:3.0:1788305458.391013:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+7:0:x1875173741541120:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305458.391039:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788305458.391166:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:0:x1875173741541120:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 1088us (17655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305458.391174:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305458.401498:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305458.401616:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541376 00000100:00100000:1.0:1788305458.401629:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541376 00000100:00100000:1.0:1788305458.401722:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305458.401814:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:13883:x1875173741541376:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788305458.401937:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:13883:x1875173741541376:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305458.401946:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305458.409989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305458.410107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305458.418129:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305458.418465:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541760 00000100:00100000:3.0:1788305458.418480:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541760 00000100:00100000:3.0:1788305458.418551:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788305458.418564:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:13883:x1875173741541760:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788305458.419179:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788305458.419352:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:13883:x1875173741541760:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 788us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305458.419372:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1788305458.424531:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541504 00000100:00100000:2.0:1788305458.424553:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541504 00000100:00100000:2.0:1788305458.424629:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541632 00000100:00100000:2.0:1788305458.424633:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541632 00000100:00100000:2.0:1788305458.424654:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1788305458.424665:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875173741541504:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788305458.424715:0:15112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb@192.168.201.38@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1788305458.424889:0:15112:0:(genops.c:1385:class_connect()) connect: client e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb, cookie 0x902a3611c9ae98a0 00002000:00100000:2.0:1788305458.424905:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb/ffff96fa83449800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305458.424921:0:15112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305458.425332:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788305458.425376:0:15112:0:(import.c:65:import_set_state_nolock()) ffff96fa8344b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305458.425602:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2346:x1875173741541504:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 936us (15626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.425610:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1788305458.425633:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305458.425658:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875173741541632:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788305458.425678:0:15112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb@192.168.201.38@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1788305458.425702:0:15112:0:(genops.c:1385:class_connect()) connect: client e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb, cookie 0x902a3611c9ae98a7 00002000:00100000:2.0:1788305458.425720:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb/ffff96fa8344e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305458.425728:0:15112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305458.426232:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305458.426254:0:15112:0:(import.c:65:import_set_state_nolock()) ffff96fa8344c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305458.426285:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2346:x1875173741541632:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 626us (16178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.426294:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788305458.733399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305458.733593:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741541888 00000100:00100000:2.0:1788305458.733604:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741541888 00000100:00100000:2.0:1788305458.733667:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1788305458.733677:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:13918:x1875173741541888:12345-192.168.201.38@tcp:101:mkdir.0 00010000:00010000:2.0:1788305458.733697:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305458.733730:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae98ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8ac expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.733807:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.733822:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.733837:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305458.734343:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788305458.734347:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305458.734428:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.734458:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae98ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.734474:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305458.734483:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:2.0:1788305458.734486:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305458.734490:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d200, rc 0) 00000100:00100000:2.0:1788305458.734552:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+7:13918:x1875173741541888:12345-192.168.201.38@tcp:101:mkdir.0 Request processed in 876us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.734560:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000040:00080000:0.0:1788305458.737762:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305459.315872:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788305460.082923:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb 00000001:00100000:3.0:1788305460.082942:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ef8d8297-bdd4-4b4d-84ef-5867cfcd497c 00010000:00010000:2.0:1788305460.341962:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305460.977549:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761456512:0@lo:400:kworker.0 00000100:00100000:3.0:1788305460.977619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305460.977688:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761457024:0@lo:400:kworker.0 00000100:00100000:3.0:1788305460.977711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305460.977735:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305460.977740:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761456640:0@lo:400:kworker.0 00000100:00100000:3.0:1788305460.977765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305460.977777:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761456384:0@lo:400:kworker.0 00000100:00100000:1.0:1788305460.977810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305460.977816:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457024 00000100:00100000:3.0:1788305460.977833:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457024 00000100:00100000:1.0:1788305460.977845:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761456896:0@lo:400:kworker.0 00000100:00100000:1.0:1788305460.977867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305460.977883:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456896 00000100:00100000:1.0:1788305460.977884:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305460.977887:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456896 00000100:00100000:1.0:1788305460.977888:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761456768:0@lo:400:kworker.0 00000100:00100000:3.0:1788305460.977909:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305460.977909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305460.977917:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761457024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788305460.977949:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305460.977960:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456768 00000100:00100000:1.0:1788305460.977963:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456768 00000100:00100000:3.0:1788305460.977964:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761457024:12345-0@lo:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305460.977970:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305460.977980:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305460.977986:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761456896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305460.977987:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788305460.977992:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761456768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.978072:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456512 00000100:00100000:2.0:1788305460.978076:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456512 00000100:00100000:2.0:1788305460.978106:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456640 00000100:00100000:2.0:1788305460.978109:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456640 00000100:00100000:2.0:1788305460.978125:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305460.978131:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761456512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.978168:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761456512:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305460.978174:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305460.978202:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305460.978208:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761456640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305460.978326:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761456768:12345-0@lo:400:kworker.0 Request processed in 25us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305460.978332:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788305460.978358:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761456384 00000100:00100000:3.0:1788305460.978368:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761456384 00000100:00100000:3.0:1788305460.978392:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788305460.978398:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761456384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.978437:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761456640:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305460.978444:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305460.978475:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761457152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305460.978504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305460.978548:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761456640:0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.978560:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761456512:0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.978572:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761457024:0@lo:400:kworker.0 00000100:00100000:0.0:1788305460.978671:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457152 00000100:00100000:0.0:1788305460.978676:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457152 00000100:00100000:0.0:1788305460.978704:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305460.978712:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761457152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305460.978739:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305460.978777:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761457152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305460.978783:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305460.978814:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761457152:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788305460.978848:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305460.978852:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305460.986654:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761456896:12345-0@lo:400:kworker.0 Request processed in 8654us (8773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305460.986669:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305460.988274:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761456384:12345-0@lo:400:kworker.0 Request processed in 9870us (10456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305460.988288:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788305460.988658:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761456768:0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.988681:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761456384:0@lo:400:kworker.0 00000100:00100000:2.0:1788305460.988699:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761456896:0@lo:400:kworker.0 00010000:00010000:0.0:1788305461.361464:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788305461.566650:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb 00010000:00010000:2.0:1788305462.385561:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305462.514194:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761457280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305462.514267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305462.514554:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457280 00000100:00100000:1.0:1788305462.514563:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457280 00000100:00100000:1.0:1788305462.514625:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305462.514645:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761457280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305462.514682:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305462.514731:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761457280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305462.514739:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305462.514882:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761457280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788305462.514942:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788305462.586516:0:16394:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788305462.644722:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb 00010000:00010000:0.0:1788305463.409375:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305463.449793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.449839:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.449872:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.449908:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.449927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.449966:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.449989:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305463.450015:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542528 00000100:00100000:1.0:1788305463.450026:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542528 00000100:00100000:1.0:1788305463.450122:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542144 00000100:00100000:1.0:1788305463.450126:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542144 00000100:00100000:3.0:1788305463.450138:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542016 00000100:00100000:3.0:1788305463.450142:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542016 00000100:00100000:1.0:1788305463.450150:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788305463.450159:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2350:x1875173741542528:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305463.450165:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:3.0:1788305463.450171:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:2350:x1875173741542016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305463.450228:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:2350:x1875173741542016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 57us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305463.450235:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1788305463.450316:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1788305463.450326:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2350:x1875173741542144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305463.450400:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542272 00000100:00100000:2.0:1788305463.450405:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542272 00000100:00100000:2.0:1788305463.450429:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542784 00000100:00100000:2.0:1788305463.450432:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542784 00000100:00100000:2.0:1788305463.450445:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542400 00000100:00100000:2.0:1788305463.450448:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542400 00000100:00100000:2.0:1788305463.450458:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542656 00000100:00100000:2.0:1788305463.450460:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542656 00000100:00100000:2.0:1788305463.450475:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1788305463.450481:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2350:x1875173741542272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305463.454791:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2350:x1875173741542528:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 2216us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305463.454815:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00080000:1.0:1788305463.454893:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305463.454899:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305463.454902:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305463.454920:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305463.454932:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788305463.454967:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305463.454979:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305463.455007:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2350:x1875173741542784:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305463.455118:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2350:x1875173741542784:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 116us (5208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305463.455125:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305463.455142:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305463.455150:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788305463.455157:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2350:x1875173741542400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305463.455187:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2350:x1875173741542400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305463.455194:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788305463.455205:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305463.455212:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305463.455352:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2350:x1875173741542656:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305463.455615:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2350:x1875173741542656:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (5392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305463.455624:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1788305463.469150:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2350:x1875173741542144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 18812us (19207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305463.469168:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788305463.475153:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2350:x1875173741542272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24658us (25299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305463.475182:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00010000:00010000:0.0:1788305464.446492:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305465.462429:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305466.097377:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761457536:0@lo:400:kworker.0 00000100:00100000:0.0:1788305466.097448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.097521:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761458048:0@lo:400:kworker.0 00000100:00100000:0.0:1788305466.097561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.097812:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305466.097820:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761457664:0@lo:400:kworker.0 00000100:00100000:0.0:1788305466.097845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305466.097955:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761457408:0@lo:400:kworker.0 00000100:00100000:2.0:1788305466.097993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305466.098029:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761457920:0@lo:400:kworker.0 00000100:00100000:2.0:1788305466.098075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305466.098094:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305466.098099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761457792:0@lo:400:kworker.0 00000100:00100000:2.0:1788305466.098122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.098271:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457536 00000100:00100000:1.0:1788305466.098281:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457536 00000100:00100000:1.0:1788305466.098331:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457664 00000100:00100000:1.0:1788305466.098334:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457664 00000100:00100000:1.0:1788305466.098358:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305466.098368:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761457536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.098420:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761457536:12345-0@lo:400:kworker.0 Request processed in 53us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.098428:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305466.098459:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305466.098476:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761457664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.098509:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761457664:12345-0@lo:400:kworker.0 Request processed in 44us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.098515:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305466.098535:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761458048 00000100:00100000:1.0:1788305466.098539:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761458048 00000100:00100000:1.0:1788305466.098791:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457920 00000100:00100000:1.0:1788305466.098796:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457920 00000100:00100000:1.0:1788305466.098818:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457792 00000100:00100000:1.0:1788305466.098820:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457792 00000100:00100000:1.0:1788305466.098832:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305466.098838:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761458048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.098872:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875173761458048:12345-0@lo:400:kworker.0 Request processed in 34us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.098879:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305466.098890:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305466.098896:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761457920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.098929:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761457920:12345-0@lo:400:kworker.0 Request processed in 34us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.098935:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305466.098945:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305466.098951:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761457792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.098978:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875173761457792:12345-0@lo:400:kworker.0 Request processed in 27us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.098984:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788305466.099013:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305466.099024:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305466.099026:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305466.099094:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875173761457792:0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.099106:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761457920:0@lo:400:kworker.0 00000100:00100000:2.0:1788305466.099518:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761458176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305466.099578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305466.099643:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761458176 00000100:00100000:2.0:1788305466.099648:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761458176 00000100:00100000:2.0:1788305466.099678:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305466.099686:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761458176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305466.099716:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788305466.099767:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761458176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.099775:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305466.099808:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761458176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305466.100186:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761457664:0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.100204:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761457536:0@lo:400:kworker.0 00000100:00100000:1.0:1788305466.100215:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875173761458048:0@lo:400:kworker.0 00000100:00100000:0.0:1788305466.100296:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761457408 00000100:00100000:0.0:1788305466.100301:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761457408 00000100:00100000:0.0:1788305466.100342:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305466.100349:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761457408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305466.100397:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761457408:12345-0@lo:400:kworker.0 Request processed in 49us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.100403:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305466.100829:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761457408:0@lo:400:kworker.0 00010000:00010000:0.0:1788305466.482322:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305466.954352:0:16543:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7f441520 20000000:00000080:1.0:1788305466.954370:0:16543:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96fbc1343400 uarg=0000000000000000 20000000:01000000:1.0:1788305466.954404:0:16543:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788305466.954408:0:16543:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788305466.954412:0:16543:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788305466.955030:0:16544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788305466.955246:0:16543:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788305466.958421:0:16543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305466.958447:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958463:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958478:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958482:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae972d expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958488:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958493:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958497:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958534:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958546:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 12 pid: 14422 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305466.958557:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458304:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305466.958679:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958685:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305466.958691:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458432:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305466.958738:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae972d expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958747:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae972d expref: 18 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305466.958755:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458560:0@lo:104: 00000100:00100000:2.0:1788305466.958793:0:16543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305466.958835:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958841:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 18 pid: 14424 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305466.958847:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458688:0@lo:104: 00000100:00100000:2.0:1788305466.958861:0:16543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305466.958882:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.958890:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 18 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305466.958897:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f28e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458816:0@lo:104: 00000100:00100000:1.0:1788305466.958901:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761458560 00000100:00100000:1.0:1788305466.958908:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761458560 00000100:00100000:2.0:1788305466.958959:0:16543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.958959:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761458688 00000100:00100000:1.0:1788305466.958962:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761458688 00000100:00100000:2.0:1788305466.958970:0:16543:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb898f3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305466.958980:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788305466.958990:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761458816 00000100:00100000:1.0:1788305466.958993:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761458816 00000100:00100000:1.0:1788305466.959008:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305466.959017:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+5:16543:x1875173761458560:12345-0@lo:104: 00010000:00010000:1.0:1788305466.959029:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959105:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305466.959116:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+5:16543:x1875173761458560:12345-0@lo:104: Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.959123:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305466.959140:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305466.959146:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+4:16543:x1875173761458688:12345-0@lo:104: 00010000:00010000:1.0:1788305466.959154:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959187:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788305466.959192:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+4:16543:x1875173761458688:12345-0@lo:104: Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.959198:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305466.959210:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305466.959216:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbba471c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:16543:x1875173761458816:12345-0@lo:104: 00010000:00010000:1.0:1788305466.959223:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959249:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788305466.959254:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbba471c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+3:16543:x1875173761458816:12345-0@lo:104: Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.959259:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305466.959267:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458560:0@lo:104: 00000100:00100000:2.0:1788305466.959274:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458688:0@lo:104: 00000100:00100000:2.0:1788305466.959280:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f28e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458816:0@lo:104: 00010000:00010000:1.0:1788305466.959295:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788305466.959300:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959308:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030200 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305466.959312:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959329:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305466.959336:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305466.959342:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305466.959378:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959385:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305466.959413:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959421:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae972d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9734 expref: -99 pid: 15829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959435:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305466.959438:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959443:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbca00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305466.959445:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959451:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305466.959456:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305466.959466:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305466.959483:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959488:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305466.959494:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959500:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbca00/0x902a3611c9ae95f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae9600 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959507:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305466.959510:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959515:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbce00 already unused, calling callback (ffffffffc1c0cc20) 10000000:00010000:1.0:1788305466.959517:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959523:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305466.959528:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305466.959532:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305466.959542:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959548:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305466.959566:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959572:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbce00/0x902a3611c9ae95ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x902a3611c9ae95b3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.959585:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305466.959587:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305466.959589:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305466.959594:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305466.959605:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761459072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305466.959634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.959659:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305466.959664:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761458944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305466.959684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.959901:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761459200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305466.959928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.959961:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459072 00000100:00100000:1.0:1788305466.959966:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459072 00010000:00010000:1.0:1788305466.959988:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 19 pid: 14424 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305466.960004:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761458944 00000100:00100000:1.0:1788305466.960007:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761458944 00010000:00010000:1.0:1788305466.960015:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae972d expref: 20 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305466.960023:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459200 00000100:00100000:1.0:1788305466.960026:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459200 00010000:00010000:1.0:1788305466.960034:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 21 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305466.960074:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305466.960080:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+21:3304:x1875173761459072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305466.960091:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305466.960096:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 21 pid: 14424 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960103:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 21 pid: 14424 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960116:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc2044e00/0x902a3611c9ae9600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae95f9 expref: 21 pid: 14424 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960128:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305466.960154:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+20:3304:x1875173761459072:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.960160:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305466.960174:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305466.960180:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761458944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305466.960188:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305466.960192:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae972d expref: 19 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960200:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae972d expref: 19 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960210:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb870bee00/0x902a3611c9ae9734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae972d expref: 19 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960228:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305466.960249:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:3304:x1875173761458944:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.960255:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305466.960267:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305466.960273:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1305450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:3301:x1875173761459200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305466.960279:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305466.960283:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 17 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960291:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 17 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960301:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fbc2045c00/0x902a3611c9ae95b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x902a3611c9ae95ac expref: 17 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.960310:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305466.960333:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1305450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:3301:x1875173761459200:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.960339:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305466.960401:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3301:1875173761459200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305466.960423:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761458944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305466.960430:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761459072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305466.963446:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458304:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305466.963468:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875173761458432:192.168.201.38@tcp:104: 00010000:00010000:2.0:1788305466.963494:0:16543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305466.964269:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305466.964338:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741542912 00000100:00100000:2.0:1788305466.964345:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741542912 00010000:00010000:2.0:1788305466.964373:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 13 pid: 14422 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305466.964403:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1788305466.964414:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:2348:x1875173741542912:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305466.964429:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305466.964434:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 13 pid: 14422 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.964446:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 13 pid: 14422 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.964461:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb80031e00/0x902a3611c9ae9892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a882 expref: 13 pid: 14422 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.964472:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305466.964512:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:2348:x1875173741542912:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.964517:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1788305466.964630:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305466.965040:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543040 00000100:00100000:0.0:1788305466.965045:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543040 00010000:00010000:1.0:1788305466.965213:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305466.965245:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1788305466.965254:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:2348:x1875173741543040:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305466.965264:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305466.965268:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965278:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965289:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb870bea00/0x902a3611c9ae985a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a820 expref: 12 pid: 14423 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965300:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965305:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965315:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965320:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965324:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965328:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965340:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7ce00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305466.965344:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965350:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965363:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.965373:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305466.965384:0:16543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.965392:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.965404:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96fb87d7ce00/0x902a3611c9ae98bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305466.965412:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:2348:x1875173741543040:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 160us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.965418:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00010000:00010000:1.0:1788305467.505416:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305467.633580:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761459328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305467.633654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305467.633788:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459328 00000100:00100000:1.0:1788305467.633799:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459328 00000100:00100000:1.0:1788305467.633858:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305467.633868:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761459328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305467.633906:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305467.633962:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761459328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305467.633970:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305467.634101:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761459328:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788305468.148943:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305468.148949:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbc1ad0000 from 10 10000000:01000000:1.0:1788305468.148953:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305468.148999:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.149026:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.149039:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305468.149086:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.149157:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305468.149202:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305468.149362:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459456 00000100:00100000:1.0:1788305468.149370:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459456 00000100:00100000:1.0:1788305468.149424:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305468.149433:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+16:14426:x1875173761459456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305468.149447:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305468.149459:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031400/0x902a3611c9ae98ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae98c3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.149483:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031400/0x902a3611c9ae98ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae98c3 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.149494:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031400/0x902a3611c9ae98ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae98c3 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.149504:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031400, rc 0) 00000100:00100000:1.0:1788305468.149547:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:14426:x1875173761459456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.149554:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305468.149611:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305468.149625:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98ca expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.149634:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae98ca expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305468.149689:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.149727:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305468.149746:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305468.149761:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459584 00000100:00100000:1.0:1788305468.149764:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459584 00000100:00100000:1.0:1788305468.149785:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788305468.149791:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:14426:x1875173761459584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.150040:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:14426:x1875173761459584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.150048:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788305468.150103:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.150130:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.150168:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305468.150181:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305468.150194:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459712 00000100:00100000:1.0:1788305468.150197:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459712 00000100:00100000:1.0:1788305468.150217:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305468.150598:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:14426:x1875173761459712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.150772:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:14426:x1875173761459712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 547us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.150787:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788305468.150939:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305468.165484:0:16568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788305468.171527:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788305468.171645:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305468.171660:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98ca expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305468.171673:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80031000/0x902a3611c9ae98c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98ca expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305468.171685:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305468.171688:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbc16b4800 from 10 10000000:01000000:3.0:1788305468.171691:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305468.171754:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305468.171762:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305468.171774:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305468.171798:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.171866:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305468.172404:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305468.176635:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459840 00000100:00100000:1.0:1788305468.176651:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459840 00000100:00100000:1.0:1788305468.176769:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305468.176781:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+17:14426:x1875173761459840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305468.176799:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305468.176819:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031a00/0x902a3611c9ae98d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae98d1 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.176848:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031a00/0x902a3611c9ae98d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae98d1 expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.176859:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031a00/0x902a3611c9ae98d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae98d1 expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.176868:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031a00, rc 0) 00000100:00100000:1.0:1788305468.176954:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761459840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.176961:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788305468.178179:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305468.178202:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98d8 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305468.178214:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae98d8 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305468.178304:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305468.178362:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305468.179352:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85245780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305468.179442:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761459968 00000100:00100000:1.0:1788305468.179449:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761459968 00000100:00100000:1.0:1788305468.179762:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788305468.179775:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761459968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.180085:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761459968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.180093:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788305468.180205:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.180265:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.180312:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305468.180563:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788305468.180657:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460096 00000100:00100000:0.0:1788305468.180662:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460096 00000100:00100000:0.0:1788305468.180687:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305468.180694:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761460096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305468.180894:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761460096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305468.180901:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788305468.184404:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305468.185780:0:16571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788305468.185960:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788305468.185994:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305468.186006:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98d8 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.186017:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fbb9dbda00/0x902a3611c9ae98d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98d8 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305468.186027:0:14426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305468.186030:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96fbb9972000 from 10 10000000:01000000:1.0:1788305468.186032:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305468.186094:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.186103:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.186114:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305468.186137:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.186202:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305468.186367:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbaf5c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305468.186441:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460224 00000100:00100000:3.0:1788305468.186449:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460224 00000100:00100000:3.0:1788305468.186497:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788305468.186507:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+18:14426:x1875173761460224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305468.186520:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305468.186531:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fbb9dbdc00/0x902a3611c9ae98e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x902a3611c9ae98df expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305468.186638:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fbb9dbdc00/0x902a3611c9ae98e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x902a3611c9ae98df expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305468.186662:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fbb9dbdc00/0x902a3611c9ae98e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x902a3611c9ae98df expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305468.186670:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbdc00, rc 0) 00000100:00100000:3.0:1788305468.186734:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761460224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305468.186740:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788305468.186816:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305468.186830:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98e6 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305468.186838:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x902a3611c9ae98e6 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305468.186889:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305468.186917:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305468.186938:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa82443e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305468.186982:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460352 00000100:00100000:3.0:1788305468.186986:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460352 00000100:00100000:3.0:1788305468.187045:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788305468.187076:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761460352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.187327:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761460352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305468.187334:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788305468.196433:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.196502:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.196668:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305468.196726:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb862a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305468.196818:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460480 00000100:00100000:1.0:1788305468.196825:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460480 00000100:00100000:1.0:1788305468.196872:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788305468.196881:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761460480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.197087:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:14426:x1875173761460480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.197096:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788305468.198864:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb90f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:14426:1875173761460480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305468.201936:0:16573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788305468.203105:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788305468.203129:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305468.203143:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98e6 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.203154:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff96fb80030200/0x902a3611c9ae98df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x902a3611c9ae98e6 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.534997:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305468.556670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305468.560121:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543168 00000100:00100000:2.0:1788305468.560140:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543168 00000100:00100000:2.0:1788305468.560215:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:2.0:1788305468.560226:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+11:13772:x1875173741543168:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305468.560244:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305468.560263:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae98ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8b3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305468.560314:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae98ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8b3 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305468.560324:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb87d7da00/0x902a3611c9ae98ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8b3 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305468.560334:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7da00, rc 0) 00000100:00100000:2.0:1788305468.560409:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13772:x1875173741543168:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 184us (3748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305468.560416:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:1.0:1788305468.560866:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.560901:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.560935:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.560950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.560967:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.560985:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.561004:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543552 00000100:00100000:1.0:1788305468.561010:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543552 00000100:00100000:1.0:1788305468.561041:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543808 00000100:00100000:1.0:1788305468.561044:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543808 00000100:00100000:1.0:1788305468.561073:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543424 00000100:00100000:1.0:1788305468.561076:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543424 00000100:00100000:1.0:1788305468.561089:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543936 00000100:00100000:1.0:1788305468.561092:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543936 00000100:00100000:1.0:1788305468.561105:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788305468.561112:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2349:x1875173741543552:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305468.561153:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2349:x1875173741543552:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.561159:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1788305468.561181:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788305468.561187:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741543808:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305468.561214:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741543808:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.561220:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1788305468.561246:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305468.561253:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2349:x1875173741543424:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305468.561276:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2349:x1875173741543424:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.561282:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1788305468.561292:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1788305468.561298:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741543936:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305468.561323:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741543936:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.561328:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1788305468.561354:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543296 00000100:00100000:1.0:1788305468.561370:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543296 00000100:00100000:1.0:1788305468.561398:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741543680 00000100:00100000:1.0:1788305468.561401:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741543680 00000100:00100000:1.0:1788305468.561421:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788305468.561426:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2349:x1875173741543296:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305468.561452:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2349:x1875173741543296:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.561457:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788305468.561474:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1788305468.561480:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2349:x1875173741543680:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1788305468.561501:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2349:x1875173741543680:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.561507:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00080000:1.0:1788305468.561525:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305468.561529:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305468.561531:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305468.575381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305468.575879:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544064 00000100:00100000:0.0:1788305468.575892:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544064 00000100:00100000:0.0:1788305468.575955:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:0.0:1788305468.575966:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13772:x1875173741544064:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305468.577845:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13772:x1875173741544064:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 1872us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.577860:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:1.0:1788305468.582386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305468.582508:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544192 00000100:00100000:3.0:1788305468.582519:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544192 00000100:00100000:3.0:1788305468.582580:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:3.0:1788305468.582592:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13772:x1875173741544192:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.582838:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13772:x1875173741544192:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 247us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305468.582847:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:3.0:1788305468.607293:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305468.607580:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544320 00000100:00100000:1.0:1788305468.607591:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544320 00000100:00100000:1.0:1788305468.607653:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:1.0:1788305468.607663:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+12:13772:x1875173741544320:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305468.607683:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305468.607713:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96fb80031800/0x902a3611c9ae98f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8ba expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.607748:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96fb80031800/0x902a3611c9ae98f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ba expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.607760:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96fb80031800/0x902a3611c9ae98f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ba expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305468.607771:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031800, rc 0) 00000100:00100000:1.0:1788305468.607842:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13772:x1875173741544320:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 181us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.607850:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:1.0:1788305468.642760:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305468.643049:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544448 00000100:00100000:0.0:1788305468.643097:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544448 00000100:00100000:0.0:1788305468.643147:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:0.0:1788305468.643156:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13772:x1875173741544448:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305468.643460:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13772:x1875173741544448:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 303us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305468.643468:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:1.0:1788305468.657531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305468.657592:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544576 00000100:00100000:3.0:1788305468.657602:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544576 00000100:00100000:3.0:1788305468.657667:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:3.0:1788305468.657679:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13772:x1875173741544576:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305468.657912:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:13772:x1875173741544576:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 234us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305468.657920:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000040:00080000:2.0:1788305468.977667:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305469.565401:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305470.577327:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305471.097911:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.098089:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544704 00000100:00100000:1.0:1788305471.098100:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544704 00000100:00100000:1.0:1788305471.098181:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1788305471.098194:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:14429:x1875173741544704:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305471.098214:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305471.098238:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031600/0x902a3611c9ae98fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8c1 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.098304:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.098317:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.098331:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.098346:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.098354:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.098361:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788305471.098668:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305471.099380:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031e00/0x902a3611c9ae9910 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.099393:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031e00/0x902a3611c9ae9910 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.099402:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031e00/0x902a3611c9ae9910 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305471.099481:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788305471.099485:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305471.102248:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031e00/0x902a3611c9ae9910 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102274:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102281:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102288:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102294:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305471.102299:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102306:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102323:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305471.102333:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305471.102340:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102345:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102362:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102368:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102373:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102379:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305471.102382:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102388:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102396:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96fbb5e39d00) 00010000:00010000:1.0:1788305471.102399:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305471.102401:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102407:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9909 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102456:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031600/0x902a3611c9ae98fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8c1 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.102485:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031e00/0x902a3611c9ae9910 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8c1 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.105949:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96fbb5e39700) 00010000:00010000:1.0:1788305471.105954:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305471.105958:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031e00, rc 0) 00000100:00100000:1.0:1788305471.106066:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:14429:x1875173741544704:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 7855us (8145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.106077:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1788305471.113209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305471.113365:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741544960 00000100:00100000:2.0:1788305471.113377:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741544960 00000100:00100000:2.0:1788305471.113442:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1788305471.113453:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:14429:x1875173741544960:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305471.113475:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305471.113512:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c400/0x902a3611c9ae9917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8c8 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.113595:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.113609:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.113620:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.113681:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.113972:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.113981:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116207:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d600/0x902a3611c9ae992c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116229:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d600/0x902a3611c9ae992c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116241:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d600/0x902a3611c9ae992c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305471.116253:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788305471.116539:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116547:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116554:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116560:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7ce00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.116564:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116582:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116595:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96fbb5e39700) 00010000:00010000:2.0:1788305471.116597:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.116601:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116606:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae991e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116619:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116625:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116631:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116636:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7dc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.116639:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116644:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.116663:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96fb88992700) 00010000:00010000:2.0:1788305471.116665:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.116668:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.117386:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae9925 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.118630:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c400/0x902a3611c9ae9917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8c8 expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.118662:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d600/0x902a3611c9ae992c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8c8 expref: 9 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.118670:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb88992900) 00010000:00010000:2.0:1788305471.118673:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.118677:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d600, rc 0) 00000100:00100000:2.0:1788305471.119413:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14429:x1875173741544960:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 5958us (6211us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788305471.119423:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1788305471.140039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.140909:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545088 00000100:00100000:1.0:1788305471.140921:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545088 00000100:00100000:2.0:1788305471.146701:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1788305471.146718:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14429:x1875173741545088:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788305471.146872:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14429:x1875173741545088:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 152us (6836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.146880:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1788305471.167013:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.167336:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545216 00000100:00100000:1.0:1788305471.167350:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545216 00000100:00100000:1.0:1788305471.167438:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1788305471.167451:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14435:x1875173741545216:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305471.167478:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305471.167513:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031600/0x902a3611c9ae993a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8cf expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.167597:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.167615:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.167628:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.167675:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.167683:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.167691:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168028:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168038:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168045:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168082:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305471.168099:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168109:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168123:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305471.168126:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305471.168132:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168139:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030000/0x902a3611c9ae9941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168165:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168172:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168178:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168184:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb80030600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305471.168187:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168194:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168203:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96fbb5e39d00) 00010000:00010000:1.0:1788305471.168206:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305471.168209:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168215:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80030600/0x902a3611c9ae9948 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168255:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031600/0x902a3611c9ae993a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8cf expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168268:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305471.168271:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305471.168281:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb80031600/0x902a3611c9ae993a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8cf expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.168293:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb80031600, rc 0) 00000100:00100000:1.0:1788305471.168379:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14435:x1875173741545216:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 930us (1381us total) trans 0 rc 301/301 00000100:00100000:1.0:1788305471.168388:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1788305471.173278:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.173434:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545344 00000100:00100000:1.0:1788305471.173448:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545344 00000100:00100000:1.0:1788305471.173525:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305471.173540:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14435:x1875173741545344:12345-192.168.201.38@tcp:700:lfs.0 00000100:00100000:1.0:1788305471.173671:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14435:x1875173741545344:12345-192.168.201.38@tcp:700:lfs.0 Request processed in 133us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.173680:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1788305471.177289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.177454:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545600 00000100:00100000:1.0:1788305471.177467:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545600 00000100:00100000:1.0:1788305471.177551:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1788305471.177564:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14435:x1875173741545600:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:1.0:1788305471.177642:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305471.177688:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae987d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a84a expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.177713:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305471.177719:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305471.178294:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.178314:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 5 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.178334:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.178383:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 5 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.178401:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 5 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305471.178420:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14431:1875173761460608:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305471.178599:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fba0492600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305471.181920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.182029:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbaf4a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14431:1875173761460608:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305471.182346:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545728 00000100:00100000:0.0:1788305471.182356:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545728 00010000:00010000:0.0:1788305471.182428:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305471.182471:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1788305471.182512:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2347:x1875173741545728:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305471.182530:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305471.182539:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.182554:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.182584:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae98b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8ac expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.182606:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:0.0:1788305471.182611:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.182623:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.182632:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.182662:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305471.182730:0:14431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.182742:0:14431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.182749:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.182781:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.182793:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.182802:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305471.185205:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788305471.185230:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.185243:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.185251:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.185258:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305471.185264:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.185274:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.185292:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fb88992b00) 00010000:00010000:1.0:1788305471.185295:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305471.185300:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.185306:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae994f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305471.185333:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018f5573a reply state 00000000b8109339 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305471.185344:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305471.185729:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2347:x1875173741545728:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 3212us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305471.185741:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00080000:0.0:1788305471.185794:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305471.185837:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+10:14435:x1875173741545600:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 8276us (8563us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788305471.185873:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00010000:00010000:2.0:1788305471.196833:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.196856:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.196894:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.196901:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.196906:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.196915:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.196937:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96fbb5e39300) 00010000:00010000:2.0:1788305471.196941:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.196946:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.196953:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f800/0x902a3611c9ae9956 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305471.218140:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761460864:0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.218247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.218323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875173761461376:0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.218353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.218387:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305471.218395:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761460736:0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.218427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.218449:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761461248:0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.218473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.218610:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460736 00000100:00100000:1.0:1788305471.218624:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460736 00000100:00100000:1.0:1788305471.218700:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788305471.218711:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761460736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.218780:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3304:x1875173761460736:12345-0@lo:400:kworker.0 Request processed in 70us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.218788:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788305471.218852:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3304:1875173761460736:0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.219256:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761461120:0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.219299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.219327:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305471.219333:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761460992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.219357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.219428:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460864 00000100:00100000:2.0:1788305471.219433:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460864 00000100:00100000:2.0:1788305471.219483:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761460992 00000100:00100000:2.0:1788305471.219486:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761460992 00000100:00100000:2.0:1788305471.219527:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305471.219537:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761460864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.219598:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875173761460864:12345-0@lo:400:kworker.0 Request processed in 62us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.219605:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305471.219621:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305471.219627:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.219666:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761460992:12345-0@lo:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.219672:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305471.219712:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761460992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.219731:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305471.219739:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761461504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305471.219767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.219797:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761461376 00000100:00100000:2.0:1788305471.219802:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761461376 00000100:00100000:2.0:1788305471.219830:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761461248 00000100:00100000:2.0:1788305471.219833:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761461248 00000100:00100000:2.0:1788305471.219846:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761461120 00000100:00100000:2.0:1788305471.219849:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761461120 00000100:00100000:1.0:1788305471.220049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875173761460864:0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.220085:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761461504 00000100:00100000:1.0:1788305471.220099:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761461504 00000100:00100000:1.0:1788305471.220128:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305471.220135:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761461504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305471.220169:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305471.220222:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761461504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.220229:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305471.220252:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305471.220259:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875173761461376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.220292:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875173761461376:12345-0@lo:400:kworker.0 Request processed in 34us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.220299:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305471.220312:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305471.220317:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761461248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.220345:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875173761461248:12345-0@lo:400:kworker.0 Request processed in 28us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.220350:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305471.220360:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305471.220366:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761461120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.220389:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875173761461120:12345-0@lo:400:kworker.0 Request processed in 24us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.220395:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305471.220421:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875173761461248:0@lo:400:kworker.0 00000100:00100000:1.0:1788305471.220432:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875173761461376:0@lo:400:kworker.0 00000100:00100000:2.0:1788305471.221003:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761461504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305471.221018:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875173761461120:0@lo:400:kworker.0 00000100:00080000:0.0:1788305471.221186:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305471.221193:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305471.221195:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305471.287820:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.288188:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545856 00000100:00100000:1.0:1788305471.288202:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545856 00000100:00100000:1.0:1788305471.288290:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1788305471.288304:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:14443:x1875173741545856:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:1.0:1788305471.288337:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305471.288388:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae995d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8d6 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.288478:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae9964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.288495:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae9964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.288509:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae9964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305471.288610:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788305471.288615:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305471.288685:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae9964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.288729:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae995d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8d6 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.288756:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e200/0x902a3611c9ae9964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8d6 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.288767:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:1.0:1788305471.288771:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305471.288774:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e200, rc 0) 00000100:00100000:1.0:1788305471.288872:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+10:14443:x1875173741545856:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 562us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.288880:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1788305471.331455:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305471.332373:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741545984 00000100:00100000:2.0:1788305471.332389:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741545984 00000100:00100000:2.0:1788305471.332478:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:2.0:1788305471.332490:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:14444:x1875173741545984:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305471.332671:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305471.332705:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae996b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.332818:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7de00/0x902a3611c9ae9972 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.332835:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7de00/0x902a3611c9ae9972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.332851:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7de00/0x902a3611c9ae9972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305471.333000:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788305471.333004:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305471.333038:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7de00/0x902a3611c9ae9972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.333570:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae996b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8dd expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.333598:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7de00/0x902a3611c9ae9972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8dd expref: 6 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.333609:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:2.0:1788305471.333612:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305471.333616:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7de00, rc 0) 00000100:00100000:2.0:1788305471.333720:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:14444:x1875173741545984:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1231us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.333729:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1788305471.339370:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305471.343706:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741546112 00000100:00100000:2.0:1788305471.343731:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741546112 00000100:00100000:2.0:1788305471.343917:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1788305471.343932:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:14444:x1875173741546112:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305471.343960:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305471.343985:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae9979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8e4 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344088:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344105:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344119:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344135:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344143:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344150:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344279:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae998e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344287:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae998e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344295:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae998e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305471.344357:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788305471.344362:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305471.344389:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae998e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344405:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344413:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344420:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344427:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.344432:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344441:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344456:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:2.0:1788305471.344459:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.344465:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344471:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344485:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344512:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344518:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344524:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.344528:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344534:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344543:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96fb88992700) 00010000:00010000:2.0:1788305471.344545:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.344548:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344554:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae9987 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344591:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae9979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8e4 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344605:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae998e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8e4 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.344613:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb88992a00) 00010000:00010000:2.0:1788305471.344616:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305471.344627:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d200, rc 0) 00000100:00100000:2.0:1788305471.345687:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+7:14444:x1875173741546112:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1749us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.345707:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:0.0:1788305471.356174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.356368:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741546368 00000100:00100000:1.0:1788305471.356400:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741546368 00000100:00100000:1.0:1788305471.356476:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1788305471.356489:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+7:14444:x1875173741546368:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305471.356527:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305471.356555:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8eb expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305471.356756:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788305471.357186:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9995 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8eb expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.357205:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:1.0:1788305471.357207:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305471.357212:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e400/0x902a3611c9ae9995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8eb expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.357229:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e400, rc 0) 00000100:00100000:1.0:1788305471.357312:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+8:14444:x1875173741546368:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 825us (1153us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788305471.357320:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1788305471.361721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305471.361903:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741546624 00000100:00100000:3.0:1788305471.361917:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741546624 00000100:00100000:3.0:1788305471.361998:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1788305471.362011:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+8:14444:x1875173741546624:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:3.0:1788305471.362339:0:16302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305471.362377:0:16302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d200/0x902a3611c9ae998e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8e4 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.362426:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb88992a00) 00010000:00010000:3.0:1788305471.362440:0:16302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305471.362472:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.362486:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.362507:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305471.364344:0:16302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5e97ade reply state 000000007741becc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305471.364366:0:16302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788305471.364399:0:16302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1788305471.364612:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+9:14444:x1875173741546624:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 2597us (2901us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788305471.364622:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00010000:00010000:0.0:1788305471.367913:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.367937:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.367945:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.367952:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305471.367958:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.367967:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.367989:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305471.367993:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788305471.367999:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.368006:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305471.368489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305471.368615:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741546880 00000100:00100000:3.0:1788305471.368628:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741546880 00000100:00100000:3.0:1788305471.368702:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788305471.368716:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+8:14444:x1875173741546880:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1788305471.369102:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+9:14444:x1875173741546880:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 388us (618us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788305471.369112:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788305471.371876:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305471.372442:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741547136 00000100:00100000:2.0:1788305471.372455:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741547136 00000100:00100000:2.0:1788305471.372532:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1788305471.372545:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+9:14444:x1875173741547136:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305471.372577:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305471.372601:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae99aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8f2 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.372718:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.372735:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.372749:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.372767:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.372774:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.372781:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305471.372968:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788305471.373152:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373160:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373167:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373174:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.373179:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373188:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373202:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:2.0:1788305471.373213:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.373219:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373226:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373240:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373246:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373253:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373268:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.373271:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373278:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373286:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96fb88992700) 00010000:00010000:2.0:1788305471.373288:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.373291:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373297:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373341:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae99aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f2 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373351:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:2.0:1788305471.373354:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305471.373357:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7ce00/0x902a3611c9ae99aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f2 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.373367:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7ce00, rc 0) 00000100:00100000:2.0:1788305471.373432:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+10:14444:x1875173741547136:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 890us (1580us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788305471.373440:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:1.0:1788305471.377316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305471.377416:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741547264 00000100:00100000:3.0:1788305471.377430:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741547264 00000100:00100000:3.0:1788305471.377510:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:3.0:1788305471.377523:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+10:14444:x1875173741547264:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1788305471.377556:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305471.377587:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae99c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a8f9 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.377947:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.377965:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.377978:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305471.378046:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788305471.378656:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788305471.380475:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.380607:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc400/0x902a3611c9ae99c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.380633:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.380677:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb8899c000) 00010000:00010000:1.0:1788305471.380680:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305471.380684:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbc600, rc 0) 00000100:00100000:1.0:1788305471.381019:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+11:14444:x1875173741547264:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3495us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.381029:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:3.0:1788305471.386956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.387344:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741547392 00000100:00100000:1.0:1788305471.387358:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741547392 00000100:00100000:1.0:1788305471.387429:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1788305471.387442:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+11:14444:x1875173741547392:12345-192.168.201.38@tcp:37:lfs.0 00000100:00100000:1.0:1788305471.396254:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+11:14444:x1875173741547392:12345-192.168.201.38@tcp:37:lfs.0 Request processed in 8798us (9296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.396271:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1788305471.403324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305471.403439:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741547648 00000100:00100000:3.0:1788305471.403453:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741547648 00000100:00100000:3.0:1788305471.403995:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1788305471.404010:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8898f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+11:14444:x1875173741547648:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1788305471.405503:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8898f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+12:14444:x1875173741547648:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 1479us (2176us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788305471.405550:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1788305471.498909:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305471.499030:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741547776 00000100:00100000:2.0:1788305471.499043:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741547776 00000100:00100000:2.0:1788305471.499170:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788305471.499188:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+10:14450:x1875173741547776:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1788305471.499221:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305471.499252:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a900 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499351:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499369:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499383:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499402:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499409:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499415:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499566:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae99e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499598:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae99e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499606:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae99e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305471.499660:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788305471.499664:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305471.499717:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae99e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499734:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499741:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499748:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499755:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.499760:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499769:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499784:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:2.0:1788305471.499787:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.499792:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499809:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c200/0x902a3611c9ae99db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499825:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499832:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499838:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499842:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7d000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.499846:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499851:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499859:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96fb88992700) 00010000:00010000:2.0:1788305471.499862:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.499864:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499870:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae99e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499908:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae99d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a900 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499934:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7dc00/0x902a3611c9ae99e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a900 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.499941:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb8899c000) 00010000:00010000:2.0:1788305471.499944:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788305471.499946:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7dc00, rc 0) 00000100:00100000:2.0:1788305471.500020:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+11:14450:x1875173741547776:12345-192.168.201.38@tcp:101:bash.0 Request processed in 838us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.500028:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1788305471.505944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305471.506101:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741548032 00000100:00100000:0.0:1788305471.506114:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741548032 00000100:00100000:0.0:1788305471.506212:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788305471.506226:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+11:14450:x1875173741548032:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305471.506256:0:16302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305471.506291:0:16302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae99f0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a907 expref: -99 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.506482:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.506624:0:16302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.506637:0:16302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.506699:0:16302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.506716:0:16302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 11 pid: 14430 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305471.506733:0:16302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16302:1875173761461632:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305471.507452:0:16302:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb852453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305471.526247:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.526470:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741548160 00000100:00100000:1.0:1788305471.526494:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741548160 00010000:00010000:1.0:1788305471.526562:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 12 pid: 14430 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305471.526607:0:16302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16302:1875173761461632:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305471.526637:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00010000:00010000:3.0:1788305471.526655:0:16302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305471.526667:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+12:2348:x1875173741548160:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305471.526692:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305471.526702:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 12 pid: 14430 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.526718:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 12 pid: 14430 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.526777:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc600/0x902a3611c9ae99cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a8f9 expref: 12 pid: 14430 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.526799:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb8899c000) 00010000:00010000:1.0:1788305471.526804:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.526815:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.526823:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.526857:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305471.526994:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+11:2348:x1875173741548160:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 335us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.527003:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00010000:00010000:3.0:1788305471.527388:0:16302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.527414:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.527441:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.527452:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.527463:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529166:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529181:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529190:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305471.529203:0:16302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788305471.529230:0:16302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529238:0:16302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529245:0:16302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529251:0:16302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:3.0:1788305471.529265:0:16302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529273:0:16302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529285:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb8899c000) 00010000:00010000:3.0:1788305471.529288:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305471.529291:0:16302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529297:0:16302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae99f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305471.529310:0:16302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0851cc5 reply state 00000000f2a94eec transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305471.529319:0:16302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788305471.529353:0:16302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae99f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 14 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529366:0:16302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 13 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305471.529373:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:3.0:1788305471.529375:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788305471.529377:0:16302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbce00, rc 0) 00000100:00100000:3.0:1788305471.529454:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+14:14450:x1875173741548032:12345-192.168.201.38@tcp:101:bash.0 Request processed in 23232us (23527us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788305471.529462:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00010000:00010000:2.0:1788305471.535439:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.535460:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.535467:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.537613:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305471.537621:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.537632:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.537663:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96fb8899c800) 00010000:00010000:2.0:1788305471.537666:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305471.537693:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.537701:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbc200/0x902a3611c9ae99fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305471.549488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305471.549668:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741548288 00000100:00100000:0.0:1788305471.549678:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741548288 00000100:00100000:0.0:1788305471.549746:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788305471.549756:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+13:14450:x1875173741548288:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1788305471.549801:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305471.549824:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9a13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a90e expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.549901:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.549915:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.549925:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305471.549970:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788305471.549974:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305471.549995:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.550004:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.550026:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9a13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 15 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.550044:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 14 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.550103:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305471.550107:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305471.550110:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bea00, rc 0) 00000100:00100000:0.0:1788305471.550178:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+14:14450:x1875173741548288:12345-192.168.201.38@tcp:101:bash.0 Request processed in 422us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305471.550185:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1788305471.559392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.560107:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741548544 00000100:00100000:1.0:1788305471.560118:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741548544 00000100:00100000:1.0:1788305471.560189:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1788305471.560201:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+14:14450:x1875173741548544:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:1.0:1788305471.560694:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+15:14450:x1875173741548544:12345-192.168.201.38@tcp:35:bash.0 Request processed in 493us (1310us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788305471.560704:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00010000:00010000:2.0:1788305471.601230:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305471.674036:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.674508:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741548800 00000100:00100000:1.0:1788305471.674531:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741548800 00000100:00100000:1.0:1788305471.674610:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:1.0:1788305471.674652:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+15:14460:x1875173741548800:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1788305471.674687:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305471.674716:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a915 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305471.674882:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788305471.675511:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a915 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.675579:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96fbb5e39d00) 00010000:00010000:1.0:1788305471.675583:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305471.675589:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a915 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.675607:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ea00, rc 0) 00000100:00100000:1.0:1788305471.675694:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+16:14460:x1875173741548800:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1055us (1670us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788305471.675702:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:2.0:1788305471.680946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.681039:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741549056 00000100:00100000:1.0:1788305471.681071:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741549056 00000100:00100000:1.0:1788305471.681159:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305471.681171:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+16:14460:x1875173741549056:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788305471.681526:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+17:14460:x1875173741549056:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 349us (587us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788305471.681535:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:3.0:1788305471.741681:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305471.741802:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741549312 00000100:00100000:2.0:1788305471.741817:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741549312 00000100:00100000:2.0:1788305471.741911:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:2.0:1788305471.741923:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+17:14463:x1875173741549312:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1788305471.741955:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305471.743003:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c400/0x902a3611c9ae9a2f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a91c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.743178:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae9a36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.743205:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.743220:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305471.743235:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788305471.743413:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c400/0x902a3611c9ae9a2f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a91c expref: 20 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.743436:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae9a36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a91c expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305471.743466:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:2.0:1788305471.743470:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305471.743474:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c800, rc 0) 00000100:00100000:2.0:1788305471.743943:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:14463:x1875173741549312:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2018us (2432us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788305471.743954:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1788305471.753545:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305471.753592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305471.753679:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741549568 00000100:00100000:0.0:1788305471.753692:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741549568 00000100:00100000:0.0:1788305471.753768:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1788305471.753780:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:2348:x1875173741549568:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305471.753800:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305471.753833:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c800/0x902a3611c9ae9a36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a91c expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305471.753853:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305471.753858:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305471.754079:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741549440 00000100:00100000:1.0:1788305471.754110:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741549440 00000100:00100000:1.0:1788305471.754140:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:1.0:1788305471.754145:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:14463:x1875173741549440:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1788305471.754217:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754230:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754239:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754277:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754283:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754288:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754293:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071ea00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305471.754297:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754302:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754308:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:1.0:1788305471.754310:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305471.754313:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305471.754325:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305471.755137:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:2348:x1875173741549568:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1351us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305471.755149:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305471.755418:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+18:14463:x1875173741549440:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 1269us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.755426:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1788305471.759366:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305471.759571:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741549824 00000100:00100000:1.0:1788305471.759585:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741549824 00000100:00100000:1.0:1788305471.759677:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788305471.759693:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+18:14463:x1875173741549824:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1788305471.760236:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:14463:x1875173741549824:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 543us (885us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788305471.760245:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000040:00080000:2.0:1788305472.051455:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788305472.179468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305472.180180:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741550080 00000100:00100000:1.0:1788305472.180199:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741550080 00000100:00100000:1.0:1788305472.180302:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:1.0:1788305472.180318:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:14494:x1875173741550080:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:1.0:1788305472.180358:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305472.180385:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a923 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.180956:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.181220:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.181265:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305472.181282:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788305472.181543:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a923 expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.181582:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a923 expref: 21 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.181592:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:1.0:1788305472.181595:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305472.181599:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ec00, rc 0) 00000100:00100000:1.0:1788305472.181711:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:14494:x1875173741550080:12345-192.168.201.38@tcp:101:cat.0 Request processed in 1396us (2266us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788305472.181720:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1788305472.193461:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305472.193524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305472.196468:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741550336 00000100:00100000:2.0:1788305472.196492:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741550336 00000100:00100000:2.0:1788305472.196619:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1788305472.196642:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:14494:x1875173741550336:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:1.0:1788305472.197382:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741550464 00000100:00100000:1.0:1788305472.197394:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741550464 00000100:00100000:1.0:1788305472.197455:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1788305472.197467:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:2349:x1875173741550464:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305472.197482:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788305472.197504:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:14494:x1875173741550336:12345-192.168.201.38@tcp:35:cat.0 Request processed in 870us (4056us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788305472.197518:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00010000:00010000:1.0:1788305472.197521:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a923 expref: 23 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.197558:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:1.0:1788305472.197565:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305472.197607:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:2349:x1875173741550464:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 143us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305472.197616:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1788305472.265858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305472.266115:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741550720 00000100:00100000:1.0:1788305472.266129:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741550720 00000100:00100000:1.0:1788305472.266214:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:1.0:1788305472.266228:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:14500:x1875173741550720:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:1.0:1788305472.266264:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305472.266293:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a60 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a92a expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.266437:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.266457:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.266467:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.266488:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.266543:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.266561:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 22 pid: 14429 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305472.266603:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1875173761461760:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305472.267160:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.267174:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305472.267185:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1875173761461888:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305472.267219:0:14430:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305472.271233:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1875173761461760:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305472.271258:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1875173761461888:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305472.271298:0:14430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305472.272309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305472.272399:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741550848 00000100:00100000:0.0:1788305472.272409:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741550848 00010000:00010000:0.0:1788305472.272463:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 23 pid: 14429 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305472.272516:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1788305472.272540:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1307850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:2347:x1875173741550848:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305472.272560:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305472.272568:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 23 pid: 14429 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.272604:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 23 pid: 14429 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.272644:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a90e expref: 23 pid: 14429 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.272666:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305472.272672:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.272682:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.272690:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305472.272774:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1307850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+22:2347:x1875173741550848:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 236us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305472.272782:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1788305472.278815:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305472.279028:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741550976 00000100:00100000:0.0:1788305472.279041:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741550976 00010000:00010000:0.0:1788305472.279138:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305472.279228:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1788305472.279241:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+22:2350:x1875173741550976:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305472.279263:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305472.279271:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.279301:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.279331:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbce00/0x902a3611c9ae9a05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a907 expref: 22 pid: 16302 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.279351:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305472.279358:0:14416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.279368:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.279378:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.279424:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305472.279499:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:2350:x1875173741550976:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 259us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305472.279509:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00010000:00010000:3.0:1788305472.287270:0:14430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305472.287294:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305472.287328:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788305472.287618:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ec00/0x902a3611c9ae9a60 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a92a expref: 22 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305472.287674:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071ea00/0x902a3611c9ae9a67 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a92a expref: 21 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305472.287685:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:3.0:1788305472.287688:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305472.287692:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071ea00, rc 0) 00000100:00100000:3.0:1788305472.287811:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:14500:x1875173741550720:12345-192.168.201.38@tcp:101:dd.0 Request processed in 21585us (21979us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788305472.287821:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:2.0:1788305472.295191:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305472.295327:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741551232 00000100:00100000:0.0:1788305472.295341:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741551232 00000100:00100000:0.0:1788305472.295408:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:0.0:1788305472.295421:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+21:14500:x1875173741551232:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:0.0:1788305472.296095:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.296118:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.296152:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305472.296215:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788305472.296261:0:14429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047e92dad reply state 00000000677d29ca transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305472.296272:0:14429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305472.296396:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14500:x1875173741551232:12345-192.168.201.38@tcp:36:dd.0 Request processed in 976us (1220us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788305472.296405:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000020:00080000:0.0:1788305472.296411:0:14429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788305472.301292:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:0.0:1788305472.301502:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.301533:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.301542:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.301550:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305472.301556:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.301565:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.301588:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305472.301592:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305472.301617:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.301634:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a75 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305472.302117:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741551360 00000100:00100000:3.0:1788305472.302131:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741551360 00000100:00100000:3.0:1788305472.302214:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1788305472.302227:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:14500:x1875173741551360:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1788305472.302269:0:16302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305472.302295:0:16302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae9a7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a931 expref: -99 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305472.302376:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae9a7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a931 expref: 24 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305472.302394:0:16302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae9a7c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a931 expref: 24 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305472.302418:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:3.0:1788305472.302421:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305472.302424:0:16302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fbb9dbca00, rc 0) 00000100:00100000:3.0:1788305472.302508:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14500:x1875173741551360:12345-192.168.201.38@tcp:101:dd.0 Request processed in 283us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305472.302515:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1788305472.353173:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305472.353392:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741551616 00000100:00100000:1.0:1788305472.353415:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741551616 00000100:00100000:1.0:1788305472.353530:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:1.0:1788305472.353547:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14500:x1875173741551616:12345-192.168.201.38@tcp:103:dd.0 00010000:00010000:1.0:1788305472.353572:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305472.353615:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbca00/0x902a3611c9ae9a7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a931 expref: 24 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305472.353653:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:1.0:1788305472.353660:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305472.353754:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:14500:x1875173741551616:12345-192.168.201.38@tcp:103:dd.0 Request processed in 211us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305472.353763:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1788305472.357274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305472.368939:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741551744 00000100:00100000:0.0:1788305472.368965:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741551744 00000100:00100000:0.0:1788305472.369191:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:0.0:1788305472.369207:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:14500:x1875173741551744:12345-192.168.201.38@tcp:58:dd.0 00010000:00010000:0.0:1788305472.369389:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.369413:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.369429:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305472.371470:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305472.374462:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788305472.375832:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788305472.376032:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:14500:x1875173741551744:12345-192.168.201.38@tcp:58:dd.0 Request processed in 6821us (18768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305472.376047:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:2.0:1788305472.380641:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305472.382189:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741551872 00000100:00100000:0.0:1788305472.382219:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741551872 00000100:00100000:0.0:1788305472.382327:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1788305472.382344:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+23:14500:x1875173741551872:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:0.0:1788305472.382374:0:16302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305472.382422:0:16302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a938 expref: -99 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.382512:0:16302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.382525:0:16302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 24 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.382550:0:16302:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.382567:0:16302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 24 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.382585:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305472.382588:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305472.382593:0:16302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 24 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305472.382602:0:16302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be000, rc 0) 00000100:00100000:0.0:1788305472.382706:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14500:x1875173741551872:12345-192.168.201.38@tcp:101:dd.0 Request processed in 365us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305472.382715:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00010000:00010000:1.0:1788305472.625445:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305472.755020:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305472.755072:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761462016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305472.755170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305472.762217:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761462016 00000100:00100000:1.0:1788305472.762244:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761462016 00000100:00100000:1.0:1788305472.762329:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305472.762344:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761462016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305472.762399:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788305472.762658:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875173761462016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 318us (7488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305472.762667:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788305472.762703:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875173761462016:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788305473.073635:0:14463:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788305473.073651:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305473.073727:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788305473.073756:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788305473.074996:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fb88f28700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14463:1875173761462144:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788305473.075260:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fa82443e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305473.090041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.090428:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741552000 00000100:00100000:1.0:1788305473.090440:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741552000 00000100:00100000:1.0:1788305473.090520:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305473.090534:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+25:14502:x1875173741552000:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788305473.090653:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+25:14502:x1875173741552000:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 Request processed in 122us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.090661:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00080000:0.0:1788305473.090746:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305473.091580:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fb88f28700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14463:1875173761462144:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305473.095497:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.095587:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741552128 00000100:00100000:2.0:1788305473.095602:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741552128 00000100:00100000:2.0:1788305473.095713:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788305473.095726:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14502:x1875173741552128:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305473.095774:0:14431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305473.097306:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14502:x1875173741552128:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 1570us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305473.097321:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1788305473.105810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.106655:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741552256 00000100:00100000:0.0:1788305473.106673:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741552256 00000100:00100000:0.0:1788305473.106889:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:0.0:1788305473.107033:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14502:x1875173741552256:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788305473.107164:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.107188:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.107203:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109376:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109402:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109416:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109451:0:16302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109461:0:16302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109467:0:16302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305473.109515:0:16302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788305473.109520:0:16302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788305473.109538:0:16302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109566:0:16302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109571:0:16302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109577:0:16302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109582:0:16302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bfe00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.109587:0:16302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109594:0:16302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109606:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb88992900) 00010000:00010000:0.0:1788305473.109609:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305473.109624:0:16302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109632:0:16302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9a91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109651:0:16302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109657:0:16302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109662:0:16302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109672:0:16302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.109675:0:16302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109681:0:16302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109689:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff96fba21af600) 00010000:00010000:0.0:1788305473.109692:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305473.109695:0:16302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109701:0:16302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9a98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109717:0:16302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109723:0:16302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109728:0:16302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109732:0:16302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.109734:0:16302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109739:0:16302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109755:0:16302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305473.109757:0:16302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305473.109760:0:16302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.109766:0:16302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9a9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.109876:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14502:x1875173741552256:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 2842us (4076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.109887:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:3.0:1788305473.115426:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.117864:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741552512 00000100:00100000:0.0:1788305473.117881:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741552512 00000100:00100000:0.0:1788305473.117960:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:0.0:1788305473.117973:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+24:14502:x1875173741552512:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305473.117995:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305473.118017:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9aa6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a93f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118144:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118161:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118174:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305473.118186:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788305473.118325:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118334:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118341:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118348:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be400 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.118353:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118363:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118377:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305473.118380:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788305473.118385:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118390:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9aad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118432:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9aa6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a93f expref: 26 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118443:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96fb88992900) 00010000:00010000:0.0:1788305473.118446:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305473.118450:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9aa6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a93f expref: 26 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.118472:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bf800, rc 0) 00000100:00100000:0.0:1788305473.118550:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+25:14502:x1875173741552512:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 579us (3139us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788305473.118558:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:2.0:1788305473.134128:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.134457:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741552640 00000100:00100000:1.0:1788305473.134474:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741552640 00000100:00100000:1.0:1788305473.134553:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:1.0:1788305473.134565:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+25:14502:x1875173741552640:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788305473.134602:0:14430:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788305473.134754:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+25:14502:x1875173741552640:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 190us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.134782:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1788305473.140299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.140425:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741552896 00000100:00100000:0.0:1788305473.140438:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741552896 00000100:00100000:0.0:1788305473.140536:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1788305473.140549:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+25:14502:x1875173741552896:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305473.140580:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305473.140620:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9abb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a946 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305473.141587:0:14429:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788305473.141598:0:14429:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788305473.141672:0:14429:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788305473.142020:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9ac2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.142040:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.142099:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.142184:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9abb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a946 expref: 28 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.142224:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a946 expref: 27 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.142234:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af600) 00010000:00010000:0.0:1788305473.142239:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305473.142243:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870be400, rc 0) 00000100:00100000:0.0:1788305473.142348:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+27:14502:x1875173741552896:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1800us (2062us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788305473.142357:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:3.0:1788305473.148255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.148393:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741553152 00000100:00100000:1.0:1788305473.148408:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741553152 00000100:00100000:1.0:1788305473.148495:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1788305473.148508:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+27:14502:x1875173741553152:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305473.148593:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305473.148639:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be400/0x902a3611c9ae9ac2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a946 expref: 27 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148668:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af600) 00010000:00010000:1.0:1788305473.148682:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305473.148716:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148744:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148757:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148775:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148782:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148789:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148914:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148923:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148929:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148935:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071e000 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305473.148941:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148949:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148957:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96fb8899c000) 00010000:00010000:1.0:1788305473.148960:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305473.148964:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148969:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071e000/0x902a3611c9ae9ad0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148978:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148984:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.148990:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.149001:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:1.0:1788305473.149005:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.149011:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.149018:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x158c03c (ffff96fbb5e39000) 00010000:00010000:1.0:1788305473.149021:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305473.149024:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.149030:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9ad7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x158c03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.149191:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+26:14502:x1875173741553152:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 683us (951us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305473.149199:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1788305473.154473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.154534:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741553280 00000100:00100000:0.0:1788305473.154556:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741553280 00000100:00100000:0.0:1788305473.154651:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:0.0:1788305473.154665:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+26:14502:x1875173741553280:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305473.154691:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305473.154721:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9ade lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a94d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.155251:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9ae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.155268:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.155282:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.155421:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9ade lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a94d expref: 28 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.155455:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfa00/0x902a3611c9ae9ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a94d expref: 27 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.155466:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:0.0:1788305473.155470:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305473.155474:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb870bfa00, rc 0) 00000100:00100000:0.0:1788305473.155576:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+27:14502:x1875173741553280:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 913us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.155585:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1788305473.158108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.158246:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741553536 00000100:00100000:1.0:1788305473.158259:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741553536 00000100:00100000:1.0:1788305473.158337:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:1.0:1788305473.158350:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+27:14502:x1875173741553536:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305473.158463:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.158484:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.158497:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305473.159118:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788305473.159132:0:14430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 490869077563ns, next at 491869074628ns, rc = 0 00000004:00010000:1.0:1788305473.159245:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003403e9fe reply state 000000008d31d0f6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.159257:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305473.159577:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+29:14502:x1875173741553536:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1226us (1480us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788305473.159586:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00010000:00010000:2.0:1788305473.162043:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305473.162295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.162404:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741553664 00000100:00100000:1.0:1788305473.162418:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741553664 00000100:00100000:1.0:1788305473.162503:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1788305473.162517:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+29:14502:x1875173741553664:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305473.162549:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305473.162574:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a954 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.163280:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.163290:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.163459:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 30 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.163492:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 30 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.163525:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:1.0:1788305473.163529:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305473.163533:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071f200, rc 0) 00000100:00100000:1.0:1788305473.163748:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+30:14502:x1875173741553664:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1233us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.163758:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00010000:00010000:2.0:1788305473.163827:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fc00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:2.0:1788305473.163844:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.163856:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.163879:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:2.0:1788305473.163881:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788305473.163886:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.163892:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071fc00/0x902a3611c9ae9aec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305473.166235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.166328:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741553792 00000100:00100000:2.0:1788305473.166341:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741553792 00000100:00100000:2.0:1788305473.166433:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1788305473.166446:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc131b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2348:x1875173741553792:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788305473.166605:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305473.167156:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc131b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2348:x1875173741553792:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 710us (934us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788305473.167165:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:3.0:1788305473.169502:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.169633:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741554048 00000100:00100000:2.0:1788305473.169646:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741554048 00000100:00100000:2.0:1788305473.169767:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1788305473.169780:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+29:14502:x1875173741554048:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788305473.170145:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+30:14502:x1875173741554048:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 366us (655us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788305473.170155:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1788305473.172010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.172210:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741554304 00000100:00100000:1.0:1788305473.172223:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741554304 00000100:00100000:1.0:1788305473.172287:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:1.0:1788305473.172300:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+30:14502:x1875173741554304:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788305473.172433:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+30:14502:x1875173741554304:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 136us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.172442:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1788305473.176179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.176479:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741554432 00000100:00100000:2.0:1788305473.176493:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741554432 00000100:00100000:2.0:1788305473.176572:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:2.0:1788305473.176586:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+30:14502:x1875173741554432:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305473.176645:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305473.176674:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9afa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a95b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.176780:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae9b01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.176797:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae9b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.176811:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae9b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305473.177013:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788305473.177041:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae9b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.177124:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7c600/0x902a3611c9ae9afa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a95b expref: 32 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.177150:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae9b01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a95b expref: 31 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.177160:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:2.0:1788305473.177164:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788305473.177169:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7d000, rc 0) 00000100:00100000:2.0:1788305473.177262:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+31:14502:x1875173741554432:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 678us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305473.177269:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1788305473.183742:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.183854:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741554560 00000100:00100000:2.0:1788305473.183870:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741554560 00000100:00100000:2.0:1788305473.183956:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1788305473.183968:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+6:2347:x1875173741554560:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305473.183995:0:15112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305473.184022:0:15112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a962 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305473.184086:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a976040, blocks: 0x1 00010000:00010000:2.0:1788305473.184120:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788305473.184125:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305473.184136:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 7 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.184160:0:15112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 7 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.184176:0:15112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb87d7c200, rc 0) 00000100:00100000:2.0:1788305473.184245:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:2347:x1875173741554560:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 279us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305473.184253:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1788305473.186914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.187281:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741554816 00000100:00100000:1.0:1788305473.187295:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741554816 00000100:00100000:1.0:1788305473.187413:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1788305473.187428:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+31:14502:x1875173741554816:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788305473.187577:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+31:14502:x1875173741554816:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 153us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.187585:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:3.0:1788305473.190028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.190259:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741554944 00000100:00100000:1.0:1788305473.190271:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741554944 00000100:00100000:1.0:1788305473.190328:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1788305473.190341:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+31:14502:x1875173741554944:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788305473.231654:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1788305473.231688:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1788305473.231694:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788305473.232036:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+26:14502:x1875173741554944:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 41688us (42011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.232049:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:2.0:1788305473.232182:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761462272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788305473.232269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305473.232517:0:16406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761462272 00000100:00100000:1.0:1788305473.232537:0:16406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761462272 00000100:00100000:1.0:1788305473.232600:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305473.233295:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb90f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761462272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788305473.233541:0:16406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788305473.233546:0:16406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788305473.233548:0:16406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788305473.233550:0:16406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788305472 -> 1788305472 00002000:00010000:1.0:1788305473.233553:0:16406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788305473.233998:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb90f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875173761462272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1386us (1725us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788305473.234008:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788305473.234042:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788305473.234248:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96fbc0f06a00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788305473.234257:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761462272:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788305473.234511:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:3.0:1788305473.234635:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1788305473.234656:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788305473.234697:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.234803:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555072 00000100:00100000:1.0:1788305473.234811:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555072 00000100:00100000:1.0:1788305473.234866:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1788305473.234877:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:2347:x1875173741555072:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788305473.234981:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:2347:x1875173741555072:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.234989:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1788305473.236981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305473.237109:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555328 00000100:00100000:3.0:1788305473.237119:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555328 00000100:00100000:3.0:1788305473.237171:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788305473.237181:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+14:14502:x1875173741555328:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305473.237254:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305473.237291:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb87d7d000/0x902a3611c9ae9b01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a95b expref: 14 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.237313:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:3.0:1788305473.237318:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305473.237352:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.237368:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.237397:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305473.237653:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077147e14 reply state 0000000000157f7b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305473.237662:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305473.237786:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+15:14502:x1875173741555328:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 605us (819us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788305473.237792:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1788305473.240292:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.240379:0:16406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555456 00000100:00100000:1.0:1788305473.240394:0:16406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555456 00000100:00100000:1.0:1788305473.240475:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1788305473.240486:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:14502:x1875173741555456:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305473.240510:0:16406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305473.240533:0:16406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb496c41512a5a969 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.240605:0:16406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.240634:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.240639:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.240646:0:16406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 8 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.240694:0:16406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.240710:0:16406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.240727:0:16406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16406:1875173761462400:192.168.201.38@tcp:104: 00000100:00100000:1.0:1788305473.240846:0:16406:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fbc0f21780 going to sleep for 11 seconds 00010000:00010000:0.0:1788305473.241719:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.241733:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.241741:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.241749:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbde00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.241755:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.241764:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.241803:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:0.0:1788305473.241806:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305473.241813:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.241819:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fbb9dbde00/0x902a3611c9ae9b0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305473.243182:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.243214:0:16406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fa83231500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16406:1875173761462400:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305473.243264:0:16406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 8 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.243294:0:16406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96fb9071e000, rc 0) 00000100:00100000:1.0:1788305473.243370:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+8:14502:x1875173741555456:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 2884us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.243402:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1788305473.243791:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555584 00000100:00100000:0.0:1788305473.243800:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555584 00010000:00010000:0.0:1788305473.243840:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.243870:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1788305473.243881:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+8:2347:x1875173741555584:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305473.243899:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305473.243928:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.243939:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.243964:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f57fe2/0x902a3611c9ae9b08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a962 expref: 8 pid: 15112 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.243979:0:14414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305473.243990:0:14414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305473.243995:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 7 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.244003:0:14414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 7 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.244215:0:14414:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 7 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.244229:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14414:1875173761462528:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788305473.244294:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85245240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305473.246376:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14414:1875173761462528:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788305473.246411:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305473.246477:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:2347:x1875173741555584:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 2596us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.246490:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1788305473.247596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.247668:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555712 00000100:00100000:1.0:1788305473.247679:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555712 00000100:00100000:1.0:1788305473.247744:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1788305473.247756:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:2347:x1875173741555712:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788305473.248010:0:15112:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788305473.248014:0:15112:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788305472 00002000:00010000:1.0:1788305473.248016:0:15112:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788305471 00002000:00010000:1.0:1788305473.248018:0:15112:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788305472 -> 1788305472 00002000:00010000:1.0:1788305473.248021:0:15112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788305473.248126:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+8:2347:x1875173741555712:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 371us (534us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788305473.248134:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1788305473.249511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.249567:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555840 00000100:00100000:2.0:1788305473.249577:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555840 00000100:00100000:2.0:1788305473.249637:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1788305473.249647:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+8:2347:x1875173741555840:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788305473.249699:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.249719:0:15115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 8 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.249726:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305473.249730:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305473.249734:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.249769:0:15115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 8 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.249781:0:15115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 8 pid: 16406 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305473.249858:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15115:1875173761462656:192.168.201.38@tcp:104: 00000100:00100000:2.0:1788305473.249947:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb83069300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305473.251556:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.251729:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15115:1875173761462656:192.168.201.38@tcp:104: 00010000:00010000:1.0:1788305473.251761:0:15115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.251942:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741555968 00000100:00100000:0.0:1788305473.251952:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741555968 00010000:00010000:0.0:1788305473.251996:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 9 pid: 16406 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.252044:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:0.0:1788305473.252143:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:2348:x1875173741555968:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305473.252204:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305473.252238:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 9 pid: 16406 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.252254:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 9 pid: 16406 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.252281:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e86018a/0x902a3611c9ae9b16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a969 expref: 9 pid: 16406 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.252323:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305473.252327:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305473.252334:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.252344:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.252381:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305473.252422:0:15115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252443:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.252447:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+8:2348:x1875173741555968:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 394us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305473.252455:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00010000:00010000:2.0:1788305473.252540:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252549:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252557:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252564:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7cc00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305473.252569:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252580:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252593:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.252600:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378baddc/0x902a3611c9ae9b1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305473.252932:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+7:2347:x1875173741555840:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 3285us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305473.252941:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1788305473.254595:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.254681:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741556224 00000100:00100000:0.0:1788305473.254708:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741556224 00000100:00100000:0.0:1788305473.254781:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1788305473.254793:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+14:14502:x1875173741556224:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788305473.254905:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.254927:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.254940:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.255267:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.255277:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.255284:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.255315:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.255326:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 15 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.255338:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875173761462784:192.168.201.38@tcp:104: 00000100:00100000:0.0:1788305473.255422:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85245240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305473.256992:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875173761462784:192.168.201.38@tcp:104: 00010000:00010000:0.0:1788305473.257040:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305473.258113:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.258277:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741556352 00000100:00100000:0.0:1788305473.258286:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741556352 00010000:00010000:0.0:1788305473.258331:0:14414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 16 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.258371:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1788305473.258382:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+16:2347:x1875173741556352:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305473.258400:0:14414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305473.258408:0:14414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 16 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.258420:0:14414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 16 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.258441:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb9071f200/0x902a3611c9ae9af3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a954 expref: 16 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.258457:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:0.0:1788305473.258470:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.258479:0:14414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.258485:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.258524:0:14414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305473.258576:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+15:2347:x1875173741556352:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 196us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.258582:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00010000:00010000:2.0:1788305473.258642:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.258649:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305473.258878:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788305473.259003:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788305473.259194:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788305473.259279:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875173761462912:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788305473.260843:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305473.260905:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb830693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305473.261360:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761462912 00000100:00100000:3.0:1788305473.261371:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761462912 00000100:00100000:3.0:1788305473.261433:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305473.261452:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1875173761462912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788305473.261570:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1875173761462912:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305473.261580:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305473.261647:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875173761462912:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788305473.262440:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788305473.262594:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875173761463040:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788305473.262671:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305473.262705:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85245780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305473.262821:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463040 00000100:00100000:1.0:1788305473.262831:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463040 00000100:00100000:1.0:1788305473.262906:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305473.262917:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14429:x1875173761463040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788305473.263260:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14429:x1875173761463040:12345-0@lo:1000:mdt00_000.0 Request processed in 344us (590us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788305473.263266:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305473.263342:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875173761463040:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788305473.263392:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263400:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263407:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263411:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bee00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.263416:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263421:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263443:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:0.0:1788305473.263446:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305473.263459:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263466:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bee00/0x902a3611c9ae9b2b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263510:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263518:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263525:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263529:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.263531:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263536:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263542:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305473.263544:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305473.263550:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 18 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263561:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 18 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263568:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 18 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.263638:0:14429:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be000/0x902a3611c9ae9a8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xb496c41512a5a938 expref: 18 pid: 16302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.263649:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875173761463168:192.168.201.38@tcp:105: 00000100:00100000:0.0:1788305473.263723:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff96fb85245000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305473.265814:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc0f07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875173761463168:192.168.201.38@tcp:105: 00010000:00010000:0.0:1788305473.265863:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265876:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bea00/0x902a3611c9ae9a83 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265924:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265942:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265956:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265968:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265973:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265978:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.265997:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bf800 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.266000:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266005:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266018:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305473.266021:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305473.266024:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266029:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bf800/0x902a3611c9ae9b32 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266042:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266048:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266077:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266083:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870be200 already unused, calling callback (ffffffffc202e4f0) 00010000:00010000:0.0:1788305473.266085:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266091:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266111:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96fb8899cf00) 00010000:00010000:0.0:1788305473.266113:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305473.266117:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.266123:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870be200/0x902a3611c9ae9b24 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.266389:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+18:14502:x1875173741556224:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 11597us (11803us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788305473.266398:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000020:00080000:0.0:1788305473.266405:0:14429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788305473.268087:0:14463:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788305473.268098:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788305473.268403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.268436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.268487:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741556480 00000100:00100000:0.0:1788305473.268502:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741556480 00000100:00100000:1.0:1788305473.268529:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741556736 00000100:00100000:1.0:1788305473.268538:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741556736 00000100:00100000:0.0:1788305473.268566:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1788305473.268579:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb8898e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:14500:x1875173741556480:12345-192.168.201.38@tcp:49:dd.0 00000040:00080000:3.0:1788305473.268668:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788305473.268679:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788305473.268753:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb8898e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+19:14500:x1875173741556480:12345-192.168.201.38@tcp:49:dd.0 Request processed in 175us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.269659:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1788305473.269744:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1788305473.269755:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+18:14502:x1875173741556736:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788305473.270629:0:14433:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788305473.270745:0:14433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788305473.270800:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.270821:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.270843:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.270853:0:14433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.270860:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.270866:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.270890:0:14433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305473.270934:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305473.270952:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.270971:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bfe00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305473.270977:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.270988:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.271015:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+20:14502:x1875173741556736:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1258us (2572us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788305473.271031:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000020:00080000:0.0:1788305473.271037:0:14433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788305473.271295:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96fba21af400) 00010000:00010000:2.0:1788305473.271299:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788305473.271305:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.271311:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96fb870bfe00/0x902a3611c9ae9b39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.271328:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305473.271329:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305473.271331:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305473.403231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.403289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.404188:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741556992 00000100:00100000:1.0:1788305473.404202:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741556992 00000100:00100000:1.0:1788305473.404299:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741556864 00000100:00100000:1.0:1788305473.404303:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741556864 00000100:00100000:1.0:1788305473.404328:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305473.404359:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+8:2350:x1875173741556992:12345-192.168.201.38@tcp:4:dd.0 00002000:00010000:1.0:1788305473.404415:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a976040, atime: 0x6a97603f, ctime: 0x6a976040, blocks: 0x1 00010000:00010000:1.0:1788305473.404424:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.404441:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:1.0:1788305473.404446:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.404453:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.404470:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.405585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1788305473.405673:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305473.406349:0:15120:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788305473.406360:0:15120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788305473.406735:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788305473.406750:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557248 00000100:00100000:0.0:1788305473.406757:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557248 00000100:00100000:0.0:1788305473.406797:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788305473.406803:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557120 00000100:00100000:0.0:1788305473.406806:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557120 00000100:00100000:0.0:1788305473.408931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.408995:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.409009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.409041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1788305473.409595:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788305473.409619:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557376 00000100:00100000:3.0:1788305473.409638:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557376 00000100:00100000:3.0:1788305473.409686:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788305473.409692:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557504 00000100:00100000:3.0:1788305473.409695:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557504 00000100:00100000:3.0:1788305473.409708:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788305473.409712:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557632 00000100:00100000:3.0:1788305473.409714:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557632 00000100:00100000:3.0:1788305473.409724:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788305473.409728:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557760 00000100:00100000:3.0:1788305473.409731:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557760 00000100:00100000:3.0:1788305473.421452:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788305473.421471:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+15:2350:x1875173741556864:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:3.0:1788305473.421516:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.421534:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305473.421538:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305473.421543:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.421557:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305473.591816:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1788305473.591846:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788305473.591862:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1788305473.591905:0:16656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788305473.591909:0:16656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788305472 -> 1788305473 00002000:00010000:3.0:1788305473.591912:0:16656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788305472 -> 1788305473 00002000:00010000:3.0:1788305473.591914:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1788305473.591947:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.591959:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.591968:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.591975:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbc000 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:3.0:1788305473.591980:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.591988:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.592009:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.592016:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d5b5ae6/0x902a3611c9ae9b47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305473.592480:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+13:2350:x1875173741556864:12345-192.168.201.38@tcp:4:dd.0 Request processed in 171006us (189181us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788305473.592493:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1788305473.592526:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1788305473.592538:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+12:2350:x1875173741557248:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:3.0:1788305473.592584:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.592597:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305473.592602:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305473.592618:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305473.592632:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595387:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595406:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595414:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595422:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fe00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305473.595427:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595456:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595475:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595482:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.595573:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+12:2350:x1875173741556992:12345-192.168.201.38@tcp:4:dd.0 Request processed in 191215us (192351us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788305473.595583:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1788305473.595626:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1788305473.595639:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fa83231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+11:2350:x1875173741557120:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:1.0:1788305473.595672:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595685:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.595689:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.595694:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.595706:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.649332:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305473.689300:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.689348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.689375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.689414:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1788305473.689441:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741558144 00000100:00100000:0.0:1788305473.689452:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741558144 00000100:00100000:0.0:1788305473.689512:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788305473.689522:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2349:x1875173741558144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305473.689599:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+6:2349:x1875173741558144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.689619:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1788305473.689643:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741558016 00000100:00100000:0.0:1788305473.689647:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741558016 00000100:00100000:0.0:1788305473.689673:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741558272 00000100:00100000:0.0:1788305473.689676:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741558272 00000100:00100000:0.0:1788305473.689700:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1788305473.689707:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2349:x1875173741558016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305473.689734:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc1319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2349:x1875173741558016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.689741:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1788305473.689752:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1788305473.689758:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741558272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1788305473.689779:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741558272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305473.689785:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00080000:0.0:1788305473.689803:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305473.689807:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305473.689810:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305473.690977:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741557888 00000100:00100000:3.0:1788305473.690987:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741557888 00000100:00100000:3.0:1788305473.691030:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:3.0:1788305473.691038:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:2349:x1875173741557888:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1788305473.691116:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb144db7-147f-43fe-ab32-9ad6a5efc614+13:2349:x1875173741557888:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305473.691123:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:0.0:1788305473.698409:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1788305473.698592:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173741558400 00000100:00100000:2.0:1788305473.698612:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173741558400 00000100:00100000:2.0:1788305473.698683:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1788305473.698693:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741558400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1788305473.698758:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e5b55a56-7a55-4edb-9e3c-749f2fd1c4bb+5:2349:x1875173741558400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305473.698765:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00080000:0.0:1788305473.699077:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788305473.734986:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788305473.735334:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:2.0:1788305473.735339:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788305473.735356:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735368:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735392:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735400:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:2.0:1788305473.735404:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735413:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735432:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735440:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305473.735540:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+13:2350:x1875173741557120:12345-192.168.201.38@tcp:4:dd.0 Request processed in 139900us (329862us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788305473.735554:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1788305473.735588:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1788305473.735613:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+12:2350:x1875173741557376:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:2.0:1788305473.735643:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735654:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305473.735677:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305473.735685:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305473.735697:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305473.818036:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788305473.828322:0:16656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1788305473.828334:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1788305473.828352:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.828365:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.828375:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.828383:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fbb9dbd600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:0.0:1788305473.828388:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.828397:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.828421:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.828428:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdeec2e/0x902a3611c9ae9b4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305473.828892:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fa83231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+12:2350:x1875173741557248:12345-192.168.201.38@tcp:4:dd.0 Request processed in 236128us (423083us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788305473.828915:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:0.0:1788305473.829432:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1788305473.829448:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+11:2349:x1875173741557504:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:0.0:1788305473.830588:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.830615:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305473.830620:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305473.830627:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305473.830643:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305473.920516:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1788305473.920968:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:1.0:1788305473.920985:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.920997:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.921006:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.921014:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb87d7c600 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305473.921019:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.921028:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.921048:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.921093:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098eaa7b2/0x902a3611c9ae9b5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305473.923456:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+11:2350:x1875173741557376:12345-192.168.201.38@tcp:4:dd.0 Request processed in 186507us (513181us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788305473.923484:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:1.0:1788305473.923606:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1788305473.923621:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc0f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+10:2349:x1875173741557632:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:1.0:1788305473.923674:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.923693:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.923698:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305473.923704:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305473.923718:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305474.085291:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1788305474.089204:0:16656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788305474.089214:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1788305474.089230:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089242:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089251:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089258:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb870bea00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305474.089276:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089285:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089305:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089313:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009834fc39/0x902a3611c9ae9b63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305474.089415:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+10:2349:x1875173741557504:12345-192.168.201.38@tcp:4:dd.0 Request processed in 259967us (680413us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788305474.089425:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1788305474.089460:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1788305474.089472:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fb88f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:2350:x1875173741557760:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:1.0:1788305474.089508:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089520:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305474.089525:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305474.089532:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.089544:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305474.141218:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1788305474.144042:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788305474.144104:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788305474.144123:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.144137:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.144146:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.144153:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071fe00 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305474.144157:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.144166:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.144187:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.144194:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a44c9cbe/0x902a3611c9ae9b6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305474.144307:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc0f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+9:2349:x1875173741557632:12345-192.168.201.38@tcp:4:dd.0 Request processed in 220686us (735291us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788305474.144333:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000001:00080000:3.0:1788305474.214122:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1788305474.214435:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.214463:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.214472:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.214479:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96fb9071f400 already unused, calling callback (ffffffffc15ef230) 00010000:00010000:1.0:1788305474.214484:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.214492:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.214512:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305474.214519:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003450ae10/0x902a3611c9ae9b71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305474.214639:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fb88f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef8d8297-bdd4-4b4d-84ef-5867cfcd497c+5:2350:x1875173741557760:12345-192.168.201.38@tcp:4:dd.0 Request processed in 125159us (805585us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788305474.214650:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00010000:00010000:2.0:1788305474.673306:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305475.698185:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788305476.068293:0:16694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1788305476.337345:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305476.337368:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761463296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305476.337451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305476.337808:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463296 00000100:00100000:0.0:1788305476.337815:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463296 00000100:00100000:0.0:1788305476.337879:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305476.337889:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761463296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305476.337926:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788305476.337973:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875173761463296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305476.337980:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788305476.338400:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305476.342287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761463680:0@lo:400:kworker.0 00000100:00100000:3.0:1788305476.342355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305476.342421:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbc16af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875173761463296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305476.342447:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305476.342452:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761463808:0@lo:400:kworker.0 00000100:00100000:3.0:1788305476.342472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305476.342497:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463680 00000100:00100000:3.0:1788305476.342503:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463680 00000100:00100000:3.0:1788305476.342542:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463808 00000100:00100000:3.0:1788305476.342544:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463808 00000100:00100000:3.0:1788305476.342585:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305476.342594:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761463680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305476.342641:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875173761463680:12345-0@lo:400:kworker.0 Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305476.342648:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305476.342663:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788305476.342669:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbb9e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761463808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305476.342690:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbb9e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875173761463808:12345-0@lo:400:kworker.0 Request processed in 22us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305476.342696:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788305476.342717:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305476.342733:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875173761463808:0@lo:400:kworker.0 00000100:00100000:3.0:1788305476.342741:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875173761463680:0@lo:400:kworker.0 00000100:00100000:2.0:1788305476.342816:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761463552:0@lo:400:kworker.0 00000100:00100000:2.0:1788305476.342846:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305476.342881:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788305476.342886:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761463424:0@lo:400:kworker.0 00000100:00100000:2.0:1788305476.342909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305476.342927:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761463936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305476.342946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305476.343101:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463424 00000100:00100000:1.0:1788305476.343106:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463424 00000100:00100000:1.0:1788305476.343130:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788305476.343137:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbaf7d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3302:x1875173761463424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305476.343173:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbaf7d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68+19:3302:x1875173761463424:12345-0@lo:400:kworker.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305476.343179:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788305476.343209:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f68cc6e-21eb-4cf1-9001-76dd2ceefc68:3302:1875173761463424:0@lo:400:kworker.0 00000100:00100000:0.0:1788305476.343358:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463936 00000100:00100000:0.0:1788305476.343362:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463936 00000100:00100000:0.0:1788305476.343404:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305476.343411:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761463936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305476.343456:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875173761463936:12345-0@lo:400:kworker.0 Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305476.343462:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305476.344400:0:16406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761463552 00000100:00100000:3.0:1788305476.344416:0:16406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761463552 00000100:00100000:3.0:1788305476.344461:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788305476.344470:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc16ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761463552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305476.344514:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc16ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761463552:12345-0@lo:400:kworker.0 Request processed in 46us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305476.344520:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788305476.344609:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305476.344613:0:14425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305476.344638:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875173761463936:0@lo:400:kworker.0 00000100:00100000:1.0:1788305476.344647:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788305476.344652:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96fbc0f06a00, transno 8589934595 00000004:00080000:1.0:1788305476.344667:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788305476.344686:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761463552:0@lo:400:kworker.0 00010000:00010000:2.0:1788305476.732748:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305477.756190:0:14417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305477.874353:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96fbb9e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761464064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305477.874426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.874563:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173761464064 00000100:00100000:3.0:1788305477.874571:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173761464064 00000100:00100000:3.0:1788305477.874629:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305477.874639:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761464064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305477.874671:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788305477.874716:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96fbc17b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875173761464064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.874723:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305477.875404:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96fbb9e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875173761464064:0@lo:13:osp-pre-0-0.0 Debug log: 29752 lines, 29752 kept, 0 dropped, 0 bad.